-- Logs begin at Mon 2022-09-05 11:37:16 UTC, end at Mon 2022-09-05 12:47:23 UTC. -- Sep 05 12:10:24.303052 dv-cinder-801354-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 05 12:10:24.310567 dv-cinder-801354-7-smb devstack@keystone.service[81671]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 12:10:24 2022] *** Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: nodename: dv-cinder-801354-7-smb Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: machine: x86_64 Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: clock source: unix Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: pcre jit disabled Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: detected number of CPU cores: 4 Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: current working directory: / Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: detected binary path: /usr/bin/uwsgi-core Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: your processes number limit is 47680 Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: your memory page size is 4096 bytes Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: detected max file descriptor number: 2048 Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: lock engine: pthread robust mutexes Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: thunder lock: enabled Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 05 12:10:24.318676 dv-cinder-801354-7-smb devstack@keystone.service[81671]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 12:10:24.355644 dv-cinder-801354-7-smb devstack@keystone.service[81671]: Python main interpreter initialized at 0x55609c5ca9c0 Sep 05 12:10:24.355644 dv-cinder-801354-7-smb devstack@keystone.service[81671]: python threads support enabled Sep 05 12:10:24.355644 dv-cinder-801354-7-smb devstack@keystone.service[81671]: your server socket listen backlog is limited to 100 connections Sep 05 12:10:24.355644 dv-cinder-801354-7-smb devstack@keystone.service[81671]: your mercy for graceful operations on workers is 90 seconds Sep 05 12:10:24.356036 dv-cinder-801354-7-smb devstack@keystone.service[81671]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 12:10:24.356115 dv-cinder-801354-7-smb devstack@keystone.service[81671]: *** Operational MODE: preforking *** Sep 05 12:10:24.356353 dv-cinder-801354-7-smb devstack@keystone.service[81671]: *** uWSGI is running in multiple interpreter mode *** Sep 05 12:10:24.356353 dv-cinder-801354-7-smb devstack@keystone.service[81671]: spawned uWSGI master process (pid: 81671) Sep 05 12:10:24.356566 dv-cinder-801354-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 05 12:10:24.357689 dv-cinder-801354-7-smb devstack@keystone.service[81671]: spawned uWSGI worker 1 (pid: 81685, cores: 1) Sep 05 12:10:24.357689 dv-cinder-801354-7-smb devstack@keystone.service[81671]: spawned uWSGI worker 2 (pid: 81686, cores: 1) Sep 05 12:10:24.357689 dv-cinder-801354-7-smb devstack@keystone.service[81671]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 12:10:28.771390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:10:28.771390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: from cryptography.utils import int_from_bytes Sep 05 12:10:28.772221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:10:28.772221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: from cryptography.utils import int_from_bytes Sep 05 12:10:28.772358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:10:28.772358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: from cryptography.utils import int_from_bytes Sep 05 12:10:28.772358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:10:28.772358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: from cryptography.utils import int_from_bytes Sep 05 12:10:28.825848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:10:28.826053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:10:28.826053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:10:28.826206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:10:28.826280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] command line args: [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:10:28.826341 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] command line args: [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:10:28.826482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:10:28.826569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:10:28.826689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ================================================================================ {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:10:28.826773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ================================================================================ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:10:28.826923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] admin_token = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] admin_token = **** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] config_dir = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] config_dir = [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] config_source = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] config_source = [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] debug = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.827869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] debug = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.828028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.828244 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.828425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.828510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.828571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.828639 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.828790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.828874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] list_limit = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_config_append = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] log_config_append = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_dir = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] log_dir = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.829989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] log_file = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.830237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_file = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.830370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.830514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.830641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.830774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.830909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.831042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.831170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.831299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.831482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.831624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.831754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.831882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.832068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.832198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.832326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.832462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.832591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.832723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.832855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.833009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.833151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.833293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.833427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.833562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.833695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.833842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.833981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.834109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.834240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.834375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.834505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.835142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.835225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] publish_errors = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.835413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] publish_errors = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.835492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.835615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.835690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.835805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.835884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] standard_threads = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] standard_threads = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836734 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.836853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.837028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.837159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.837302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.837434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] use_journal = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.837559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_journal = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.837690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] use_json = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.837813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_json = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.837940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] use_stderr = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.838064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_stderr = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.838188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] use_syslog = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.838316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_syslog = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.838440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.838570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:10:28.838890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.838974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.839993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.840937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.841953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.842058 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.842147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.842319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.842398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.842592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.842671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.842850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.843558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.843634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.843705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.843870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.843946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.844104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.844192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.844339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.844416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.844578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.844653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.844833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.844916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.845109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.845242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.845345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.845423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.845581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.845664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.845828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.845903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.846080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.846158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.846323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.846406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.846571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.846646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.846807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.846881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.847987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.848215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.848332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.848431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.848534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.848631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.848725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.848826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.848929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.849098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.856400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.856494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.856622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.856705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.856778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.856848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.856917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857169 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.857986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.858054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.858124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.858192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.858261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.858337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.858408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.858477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.858681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.859987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.860938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.861990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.862958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.863956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.864940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.external = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.865982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] auth.external = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.password = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.token = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.866983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] auth.password = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] auth.token = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867244 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.867829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] credential.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.868962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.869047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.869176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.869258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.869426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.869512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.869680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.869766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.869943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.870025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.870189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.870270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.870450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.870529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.870708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.870787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.870950 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.871028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.871191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.871270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.871441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.871520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.871692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.871770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.871926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.872004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] federation.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.872177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.872249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.872419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.872488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.872681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.872774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.872905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.873013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.873443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.873538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.873601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.873721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.873807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.873880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.873951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.874021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.874205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.874286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.874452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.874531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.874690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.874766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.874930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875181 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875414 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.875975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.876149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.876228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.876384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.876461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.876620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.876699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.876854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.876932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.877127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.877207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.877365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.877443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.877603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.877681 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.877842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.877927 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.878092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.878211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.878344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.878423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.878597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.878684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.878858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.878937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.879097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.879174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.879339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.879425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.879573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.879652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.879814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.879892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.880060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.880145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.880303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.880379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.880536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.880613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.880778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.880868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.881047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.881130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.881307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.881397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.881568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.881659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.881821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.881899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.882071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.882157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.882306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.882392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.882549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.882628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.882785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.882864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.883988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.884065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.884241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.884320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.884505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.884671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.884750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.884913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.885010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.885175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.885253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.885431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.885621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.885701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.885861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.885940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.886100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.886187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.886359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.886437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.886751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.886812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.886895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.887076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.887154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.887319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.887397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.887557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.887643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.887805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.887883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.888064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.888141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.888300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.888389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.888533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.888614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.888774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.888853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.889988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.890059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.890233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.890318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.890508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.890618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.890761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.890841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.891991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.892069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.892229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.892306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.892473 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.892550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.892715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.892795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893216 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.893972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.894063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.894210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.894312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.894452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.894551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.894702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.894802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.894947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.895027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.895181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.895259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.895421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.895499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.895667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.895780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.896032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.896113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.896269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.896370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.896512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.896619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.896791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] resource.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.896915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.897076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.897154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.897318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.897400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.897560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.897639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.897813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.897891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.898069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.898151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.898311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.898389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] role.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.898560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.898639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] role.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.898802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.898882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.899051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.899129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.899291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] role.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.899369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.899543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] role.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.899623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.899778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.899856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.900031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.900108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.900547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.900629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.900797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.900873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.901071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.901153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.904199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.904330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.904525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.904606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.904681 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.904754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.904839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.904915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.905017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.905106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.905106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.905250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.905326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.905398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.905991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.906958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907037 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.907949 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.908933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] token.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.909939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.910066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.910181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.910317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.910426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.910565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.910658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.910817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.910898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.911061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.911172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.911308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.911393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.911549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.911640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.911800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.911887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.912081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.912163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.912318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.912411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.912568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.912649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.912822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.912909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.913092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.913175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.connection = **** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.913334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.913415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.913574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.913733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.913813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.913880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.914082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.914161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.914331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.914419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.914572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.914653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.914819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.914924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.915069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.915165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.915293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.915372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.915531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.915612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.915776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.915864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.916008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.916088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.916251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.916331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.916489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.916576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.916651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:10:28.916723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.917002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.917222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.917462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:10:28.917638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81685) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:10:28.947644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.947888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.948078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.948474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.948714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.948959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.956630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.957559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.986828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.987063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.987174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:28.987383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.042457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.042711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.098166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.098367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.098449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.098556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.260074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.260314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.260530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.260753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.260838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.260998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.261085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.261224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.261312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.261474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.261695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.261913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.285385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.285600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.285696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.285771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.285846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.285951 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.286048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.286170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.286254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.286386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.286470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.286601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.286685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.286815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.297935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.298153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.310364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.310603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.310828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.310938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.311055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.311177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.311276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.311408 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.311492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.311653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.311735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81685) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.311877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.312093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.312309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:10:29.328807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.329048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 12:10:29.329312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.329402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.329527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 12:10:29.329610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 12:10:29.329847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.329928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.330064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 12:10:29.330144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.330341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.330421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.330607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.330687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.330872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.331134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.340219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.340502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.340778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.340874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.341090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.341174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.341406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.341692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.348629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.349229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.351553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.351841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.352119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.352200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.352405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.352485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.352692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.352774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.352972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.353067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.353252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.353335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.353533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.353616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.353809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.353891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.354088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.354166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.354358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.354436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.354635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.354907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.378099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.378254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.379568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.379705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.379851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.379995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.384507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.384656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.384792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.384962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.385105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.385254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.392031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.392132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.392323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.392409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.398066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.398169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.398361 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.398460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.398651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.398736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.398940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.399023 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.399222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.399307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.399504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.399587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.399779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.399860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.400048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.400131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.415692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.415790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.415991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.416166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.419815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.419952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.423064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.423151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.423368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.423474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.427542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.427642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.430702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.430827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.433922 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.434080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.434227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.434392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.434517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.434684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.434810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.434973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.435097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.435257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.435384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.435562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.451542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.451846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.451934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.452122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.452209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.452940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.453062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.453298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.459805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.460141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.461388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.461733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.462910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.463249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.463345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.463523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.466040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.466280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.466380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.466572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.466690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.466889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.466974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.467194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.467279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.467594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.478430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.478725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.478825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.479014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.479099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.479299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.479382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.479587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.479685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.479965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.480048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.480249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.480333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.480534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.495585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.495920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.498524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.498857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.501950 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.502318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.503399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.503763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.504880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.505195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.505289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.505561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.505646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.505964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.511942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.512305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.513438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.513792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.516878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.517304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.517392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.517597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.517708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.517883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.518004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.518289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.525929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.526233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.526317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.526521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.526620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.526902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.533418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81685) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.533708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.533792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:10:29.533997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.534083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.534279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.534363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.534560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.534645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.534841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.534927 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.535122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.535206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.535399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.535490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.535670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.535756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.535952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.536034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.536234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.536317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.536501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.536584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.536764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.536846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.537061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81685) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.537147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.537331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:10:29.571606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55609c5ca9c0 pid: 81685 (default app) Sep 05 12:10:29.571766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55609c5ca9c0 pid: 81686 (default app) Sep 05 12:10:29.574810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63831-7215-4bf4-8f1b-349e4d22f395 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:29.575098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63831-7215-4bf4-8f1b-349e4d22f395 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:29.575373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c63831-7215-4bf4-8f1b-349e4d22f395 None None] PATH_INFO: `/v3` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:29.580153 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Mon Sep 5 12:10:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:37.096290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c68f7-14b5-4d2a-87c2-16117cd8dcc4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:37.096785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c68f7-14b5-4d2a-87c2-16117cd8dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:37.096869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c68f7-14b5-4d2a-87c2-16117cd8dcc4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:37.101115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:37.106295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260239a7-a295-463e-a337-38fce8f23723 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:37.106827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260239a7-a295-463e-a337-38fce8f23723 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:37.106929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260239a7-a295-463e-a337-38fce8f23723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:37.177198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: INFO dbcounter [None req-260239a7-a295-463e-a337-38fce8f23723 None None] Registered counter for database keystone Sep 05 12:10:37.199036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG oslo_db.sqlalchemy.engines [None req-260239a7-a295-463e-a337-38fce8f23723 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81685) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:37.206016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writer thread running {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:37.396388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG passlib.handlers.bcrypt [None req-260239a7-a295-463e-a337-38fce8f23723 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81685) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 12:10:37.396683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG passlib.handlers.bcrypt [None req-260239a7-a295-463e-a337-38fce8f23723 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81685) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 12:10:37.454843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-260239a7-a295-463e-a337-38fce8f23723 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:37.456452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-260239a7-a295-463e-a337-38fce8f23723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:37.584203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 05 12:10:38.066759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c68f7-14b5-4d2a-87c2-16117cd8dcc4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:38.136555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: INFO dbcounter [None req-173c68f7-14b5-4d2a-87c2-16117cd8dcc4 None None] Registered counter for database keystone Sep 05 12:10:38.157110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG oslo_db.sqlalchemy.engines [None req-173c68f7-14b5-4d2a-87c2-16117cd8dcc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:10:38.163602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writer thread running {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:10:38.287375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c68f7-14b5-4d2a-87c2-16117cd8dcc4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:38.291725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7415c-2379-4877-9e21-cc1914e90a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:38.292344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7415c-2379-4877-9e21-cc1914e90a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:38.292629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7415c-2379-4877-9e21-cc1914e90a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:38.292904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7415c-2379-4877-9e21-cc1914e90a95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:38.301252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7415c-2379-4877-9e21-cc1914e90a95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:38.352448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING keystone.common.rbac_enforcer.enforcer [None req-92b7415c-2379-4877-9e21-cc1914e90a95 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 12:10:38.352797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7415c-2379-4877-9e21-cc1914e90a95 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:38.362578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Sep 5 12:10:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 12:10:38.368531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260239a7-a295-463e-a337-38fce8f23723 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:38.383276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260239a7-a295-463e-a337-38fce8f23723 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:38.387744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5661a-254a-4fa6-9c5a-823503fcc10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:38.388827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5661a-254a-4fa6-9c5a-823503fcc10f admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:38.389234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5661a-254a-4fa6-9c5a-823503fcc10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:38.390107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5661a-254a-4fa6-9c5a-823503fcc10f admin admin] PATH_INFO: `/v3/projects/a729dadde8474df3811deb87cd30d71e` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:38.391679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5661a-254a-4fa6-9c5a-823503fcc10f admin admin] RBAC: Authorizing `identity:get_project(project_id=a729dadde8474df3811deb87cd30d71e)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:38.443924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING keystone.common.rbac_enforcer.enforcer [None req-32c5661a-254a-4fa6-9c5a-823503fcc10f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 12:10:38.444297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5661a-254a-4fa6-9c5a-823503fcc10f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:38.449017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Mon Sep 5 12:10:38 2022] GET /identity/v3/projects/a729dadde8474df3811deb87cd30d71e => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:40.377527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a082-6136-41a2-9809-132f9b4015b2 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:40.378188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a082-6136-41a2-9809-132f9b4015b2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:40.378188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a082-6136-41a2-9809-132f9b4015b2 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:40.382176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:40.387800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c988fc-cefa-4b78-aa04-5188df01efef None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:40.388245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c988fc-cefa-4b78-aa04-5188df01efef None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:40.388365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c988fc-cefa-4b78-aa04-5188df01efef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:40.409218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-87c988fc-cefa-4b78-aa04-5188df01efef None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:40.410886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-87c988fc-cefa-4b78-aa04-5188df01efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:40.418870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 05 12:10:40.689941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a082-6136-41a2-9809-132f9b4015b2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:40.702640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a082-6136-41a2-9809-132f9b4015b2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:40.706827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115a29a-125b-4294-bf47-d4c228a175dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:40.707427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a29a-125b-4294-bf47-d4c228a175dd admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:40.707704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a29a-125b-4294-bf47-d4c228a175dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:40.707987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115a29a-125b-4294-bf47-d4c228a175dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:40.716088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115a29a-125b-4294-bf47-d4c228a175dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:40.717943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115a29a-125b-4294-bf47-d4c228a175dd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:40.726688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Sep 5 12:10:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 12:10:40.732530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c988fc-cefa-4b78-aa04-5188df01efef None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:40.741886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c988fc-cefa-4b78-aa04-5188df01efef None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:40.746209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8104f-e718-4054-8509-31bb8bb32578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:40.746836 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8104f-e718-4054-8509-31bb8bb32578 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:40.747116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8104f-e718-4054-8509-31bb8bb32578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:40.747385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8104f-e718-4054-8509-31bb8bb32578 admin admin] PATH_INFO: `/v3/users/de668eb3aa574c6fb312d4e0c57de17b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:40.749447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8104f-e718-4054-8509-31bb8bb32578 admin admin] RBAC: Authorizing `identity:get_user(user_id=de668eb3aa574c6fb312d4e0c57de17b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:40.751298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8104f-e718-4054-8509-31bb8bb32578 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:40.752853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Mon Sep 5 12:10:40 2022] GET /identity/v3/users/de668eb3aa574c6fb312d4e0c57de17b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:42.766187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351a06-8b60-495e-8c05-b7699a9ad601 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:42.766727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351a06-8b60-495e-8c05-b7699a9ad601 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:42.766727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8351a06-8b60-495e-8c05-b7699a9ad601 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:42.768064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:42.773248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10af0-6a62-422a-9646-efb707cf2a1a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:42.773688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10af0-6a62-422a-9646-efb707cf2a1a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:42.773808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa10af0-6a62-422a-9646-efb707cf2a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:42.792068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e29c2-93c7-4912-862e-4d0a0fb77ac6 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:42.792361 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e29c2-93c7-4912-862e-4d0a0fb77ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:42.792640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e29c2-93c7-4912-862e-4d0a0fb77ac6 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:42.792738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6aa10af0-6a62-422a-9646-efb707cf2a1a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:42.793891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6aa10af0-6a62-422a-9646-efb707cf2a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:42.793999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:42.799750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:42.800032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:42.800308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:42.844902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG passlib.handlers.bcrypt [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81686) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 12:10:42.845324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG passlib.handlers.bcrypt [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81686) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 12:10:42.879784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:10:42.895216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:42.896834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:42.999228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:10:43.148815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa10af0-6a62-422a-9646-efb707cf2a1a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:43.173767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:43.258199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa10af0-6a62-422a-9646-efb707cf2a1a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:43.274351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:43.298505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328bb5d-eb0d-4f7f-9236-22053e7b5b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:43.299149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328bb5d-eb0d-4f7f-9236-22053e7b5b80 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.299434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328bb5d-eb0d-4f7f-9236-22053e7b5b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.299723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328bb5d-eb0d-4f7f-9236-22053e7b5b80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.311268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328bb5d-eb0d-4f7f-9236-22053e7b5b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-8328bb5d-eb0d-4f7f-9236-22053e7b5b80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:10:43.320255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:43.321323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:10:43.322135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:10:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:10:43.328010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328bb5d-eb0d-4f7f-9236-22053e7b5b80 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:43.381786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff1076-e5b1-458b-9704-8fb2b58f9342 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:43.384148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:43.420388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:43.421720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002dc1c-9b25-4599-b836-1d6de5b7c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:43.422588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002dc1c-9b25-4599-b836-1d6de5b7c835 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.422876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002dc1c-9b25-4599-b836-1d6de5b7c835 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.423153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002dc1c-9b25-4599-b836-1d6de5b7c835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.438353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328bb5d-eb0d-4f7f-9236-22053e7b5b80 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:43.473029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:43.473645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.473928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.474203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.474875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:43.475184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:43.476601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:43.489086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:10:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:43.490916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002dc1c-9b25-4599-b836-1d6de5b7c835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:43.492541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002dc1c-9b25-4599-b836-1d6de5b7c835 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:43.494639 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:43.599678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a517f2e-0753-4313-b0f0-6534770fb98b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:43.606909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:10:43.613093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002dc1c-9b25-4599-b836-1d6de5b7c835 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:43.616941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:43.636091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828be60-c6c5-4b24-bed1-33caec04acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:43.636830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828be60-c6c5-4b24-bed1-33caec04acd9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.637146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828be60-c6c5-4b24-bed1-33caec04acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.637458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828be60-c6c5-4b24-bed1-33caec04acd9 None admin] PATH_INFO: `/v3/users/de668eb3aa574c6fb312d4e0c57de17b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.638676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828be60-c6c5-4b24-bed1-33caec04acd9 None admin] RBAC: Authorizing `identity:get_user(user_id=de668eb3aa574c6fb312d4e0c57de17b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:43.640739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828be60-c6c5-4b24-bed1-33caec04acd9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:43.642554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:10:43 2022] GET /identity/v3/users/de668eb3aa574c6fb312d4e0c57de17b => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:43.647994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828be60-c6c5-4b24-bed1-33caec04acd9 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:43.663208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:43.718328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002dc1c-9b25-4599-b836-1d6de5b7c835 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:43.748097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828be60-c6c5-4b24-bed1-33caec04acd9 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:43.751521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:43.752404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.752686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.752982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.771836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:43.773334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:43.783318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016c66e-c38f-40ab-98a4-64671b9844fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:43.783938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c66e-c38f-40ab-98a4-64671b9844fe None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.784217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c66e-c38f-40ab-98a4-64671b9844fe None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.784488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016c66e-c38f-40ab-98a4-64671b9844fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.785626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016c66e-c38f-40ab-98a4-64671b9844fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:43.787061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016c66e-c38f-40ab-98a4-64671b9844fe None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:43.788601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:10:43.792109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:43.793124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:10:43.793958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:10:43.793958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:10:43.793958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:10:43.793958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:10:43.795916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016c66e-c38f-40ab-98a4-64671b9844fe None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:43.799388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:43.858280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:43.877854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:43.896565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016c66e-c38f-40ab-98a4-64671b9844fe None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:43.903133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d7d83-751d-470c-bb53-02598762be8f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:43.931749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74f5a4-5f5f-4b6a-8ae6-2e794fa68d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:43.932360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f5a4-5f5f-4b6a-8ae6-2e794fa68d78 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.932644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f5a4-5f5f-4b6a-8ae6-2e794fa68d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.932919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f5a4-5f5f-4b6a-8ae6-2e794fa68d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.933680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74f5a4-5f5f-4b6a-8ae6-2e794fa68d78 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.domain.id=default, user.id=de668eb3aa574c6fb312d4e0c57de17b) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:43.933992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74f5a4-5f5f-4b6a-8ae6-2e794fa68d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:43.935430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74f5a4-5f5f-4b6a-8ae6-2e794fa68d78 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:43.941420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5f844-fb4b-4685-81b1-59892ac11638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:43.942033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5f844-fb4b-4685-81b1-59892ac11638 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.942142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Sep 5 12:10:43 2022] GET /identity/v3/role_assignments?user.id=de668eb3aa574c6fb312d4e0c57de17b&scope.domain.id=default&role.id=41491b52194f43e2902307fb86036726 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:43.942316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5f844-fb4b-4685-81b1-59892ac11638 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.942588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5f844-fb4b-4685-81b1-59892ac11638 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.943234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5f844-fb4b-4685-81b1-59892ac11638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:43.943536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5f844-fb4b-4685-81b1-59892ac11638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:43.944929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5f844-fb4b-4685-81b1-59892ac11638 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:43.964630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:46.157172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ddbd-a871-494d-93dc-616d7b6aeefe None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.157689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ddbd-a871-494d-93dc-616d7b6aeefe None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.157788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ddbd-a871-494d-93dc-616d7b6aeefe None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.159119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:46.164468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef588-a9da-422e-9cda-9b46c800abb2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.164959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef588-a9da-422e-9cda-9b46c800abb2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.165138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdef588-a9da-422e-9cda-9b46c800abb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.188570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5cdef588-a9da-422e-9cda-9b46c800abb2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:46.189814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5cdef588-a9da-422e-9cda-9b46c800abb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:46.287555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:10:46.503026 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df965cf-b7ed-4965-a229-37e5da62be08 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.503362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df965cf-b7ed-4965-a229-37e5da62be08 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.503532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df965cf-b7ed-4965-a229-37e5da62be08 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.504856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:46.510609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47a61-e8e2-4324-a503-b09c6b0a0b9a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.510909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47a61-e8e2-4324-a503-b09c6b0a0b9a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.511243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f47a61-e8e2-4324-a503-b09c6b0a0b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.537993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-69f47a61-e8e2-4324-a503-b09c6b0a0b9a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:46.539271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-69f47a61-e8e2-4324-a503-b09c6b0a0b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:46.552829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc337a-2ad1-448d-bfd6-283d1e7156b3 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.553476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc337a-2ad1-448d-bfd6-283d1e7156b3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.553947 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc337a-2ad1-448d-bfd6-283d1e7156b3 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.555733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 14/25] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:46.570331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba9e03-b8b3-4fc7-b6c7-661af4cd4ae7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.570943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba9e03-b8b3-4fc7-b6c7-661af4cd4ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.571433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba9e03-b8b3-4fc7-b6c7-661af4cd4ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.599021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:46.604514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1cba9e03-b8b3-4fc7-b6c7-661af4cd4ae7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:46.606045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1cba9e03-b8b3-4fc7-b6c7-661af4cd4ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:46.651886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 12/26] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:10:46.716377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59cb85-a309-4c84-9b5a-bc8b82abfa84 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.716727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59cb85-a309-4c84-9b5a-bc8b82abfa84 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.717014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59cb85-a309-4c84-9b5a-bc8b82abfa84 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.719538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:46.727114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a89a-b984-4214-8edb-c3369e6a4b5c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.727416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a89a-b984-4214-8edb-c3369e6a4b5c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.727673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a89a-b984-4214-8edb-c3369e6a4b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.743564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 15/28] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:10:46.762067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fa86a89a-b984-4214-8edb-c3369e6a4b5c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:46.763272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fa86a89a-b984-4214-8edb-c3369e6a4b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:46.848144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba9e03-b8b3-4fc7-b6c7-661af4cd4ae7 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:46.886052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 14/29] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:10:46.970102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:47.003750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba9e03-b8b3-4fc7-b6c7-661af4cd4ae7 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:47.052597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:47.053191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.053481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.053761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.064938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:47.066467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:10:47.089048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:47.089967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:10:47.090774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:10:47.090774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:10:47.090774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:10:47.090774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 16/30] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:10:47.096144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86a89a-b984-4214-8edb-c3369e6a4b5c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:47.113082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:47.258032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86a89a-b984-4214-8edb-c3369e6a4b5c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:47.273203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:47.289061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2159-0484-4f98-aae2-b08d80d636d6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:47.311462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:47.312317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.313055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.313476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.314290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:47.314801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:47.316515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:47.332030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 15/31] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:47.333233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:47.338591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:47.358440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983efb-0fa2-4514-846f-e88dcd265661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:47.359347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983efb-0fa2-4514-846f-e88dcd265661 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.359805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983efb-0fa2-4514-846f-e88dcd265661 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.360222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983efb-0fa2-4514-846f-e88dcd265661 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.361081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42983efb-0fa2-4514-846f-e88dcd265661 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:47.362632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42983efb-0fa2-4514-846f-e88dcd265661 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:47.459787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07233c59-4c17-4502-8e8d-836c0719d8b6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:47.503108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e227e6-b6d9-4661-9c68-6b203fa1ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:47.504150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e227e6-b6d9-4661-9c68-6b203fa1ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.504648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e227e6-b6d9-4661-9c68-6b203fa1ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.505237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e227e6-b6d9-4661-9c68-6b203fa1ccb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.521365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e227e6-b6d9-4661-9c68-6b203fa1ccb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-96e227e6-b6d9-4661-9c68-6b203fa1ccb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:10:47.528929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:47.529902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:10:47.530689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:10:47.533532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:10:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:10:47.534925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e227e6-b6d9-4661-9c68-6b203fa1ccb4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:47.569077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:47.583115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 17/33] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Sep 5 12:10:47 2022] POST /identity/v3/roles => generated 219 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:10:47.584514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983efb-0fa2-4514-846f-e88dcd265661 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:47.699351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e227e6-b6d9-4661-9c68-6b203fa1ccb4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:47.740272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073821d1-4a17-483a-9cb1-eff68e767c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:47.740272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073821d1-4a17-483a-9cb1-eff68e767c9d None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.740617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073821d1-4a17-483a-9cb1-eff68e767c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.740711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073821d1-4a17-483a-9cb1-eff68e767c9d None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.742388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073821d1-4a17-483a-9cb1-eff68e767c9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:47.743399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073821d1-4a17-483a-9cb1-eff68e767c9d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:47.759142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983efb-0fa2-4514-846f-e88dcd265661 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:47.800120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba4d0-5b31-4916-a116-4fb1e721ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:47.800917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba4d0-5b31-4916-a116-4fb1e721ea66 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.801229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba4d0-5b31-4916-a116-4fb1e721ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.801514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ba4d0-5b31-4916-a116-4fb1e721ea66 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.802196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ba4d0-5b31-4916-a116-4fb1e721ea66 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:47.803805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ba4d0-5b31-4916-a116-4fb1e721ea66 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:47.920727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 18/34] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Sep 5 12:10:47 2022] POST /identity/v3/roles => generated 225 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:10:47.925036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba4d0-5b31-4916-a116-4fb1e721ea66 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:47.978909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:47.998687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 17/35] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:10:47 2022] POST /identity/v3/projects => generated 301 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:10:47.998687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae971e8-c34e-4164-ae0b-c4636a1690d0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.998687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae971e8-c34e-4164-ae0b-c4636a1690d0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.998687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae971e8-c34e-4164-ae0b-c4636a1690d0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.998687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:47.998687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541ee9a-f6bf-4560-9662-0a658a0339a5 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.998687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541ee9a-f6bf-4560-9662-0a658a0339a5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.999262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541ee9a-f6bf-4560-9662-0a658a0339a5 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.999262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 19/37] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:47.999262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d4f0b-cd6b-4bf5-9017-0ebe3597f9a3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.999262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d4f0b-cd6b-4bf5-9017-0ebe3597f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.999483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d4f0b-cd6b-4bf5-9017-0ebe3597f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.020892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ea5d4f0b-cd6b-4bf5-9017-0ebe3597f9a3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:48.022622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ea5d4f0b-cd6b-4bf5-9017-0ebe3597f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:48.064006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ba4d0-5b31-4916-a116-4fb1e721ea66 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:48.105698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 20/38] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:10:48.107130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531f20d-2f9b-410a-8eb4-5d7b3f6a324d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.107487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531f20d-2f9b-410a-8eb4-5d7b3f6a324d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.107847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531f20d-2f9b-410a-8eb4-5d7b3f6a324d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.110411 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:48.111051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.111340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.111618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.112351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:48.112723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:48.114239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:48.124478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 19/39] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:10:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:48.131497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:48.150428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0531f20d-2f9b-410a-8eb4-5d7b3f6a324d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:48.151645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0531f20d-2f9b-410a-8eb4-5d7b3f6a324d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:48.156788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:48.244245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 21/40] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:10:48.276908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e596-e3e4-4611-b3c2-eb68ddd479dc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:48.287613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:48.326315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cceff-65df-414d-a563-7d388c447c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:48.327390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cceff-65df-414d-a563-7d388c447c06 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.327884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cceff-65df-414d-a563-7d388c447c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.328363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cceff-65df-414d-a563-7d388c447c06 None admin] PATH_INFO: `/v3/users/de668eb3aa574c6fb312d4e0c57de17b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.330346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cceff-65df-414d-a563-7d388c447c06 None admin] RBAC: Authorizing `identity:get_user(user_id=de668eb3aa574c6fb312d4e0c57de17b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:48.333060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cceff-65df-414d-a563-7d388c447c06 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:48.337128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 20/41] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:10:48 2022] GET /identity/v3/users/de668eb3aa574c6fb312d4e0c57de17b => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:48.345642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531f20d-2f9b-410a-8eb4-5d7b3f6a324d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:48.410230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cceff-65df-414d-a563-7d388c447c06 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:48.509050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531f20d-2f9b-410a-8eb4-5d7b3f6a324d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:48.528278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cceff-65df-414d-a563-7d388c447c06 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:48.546100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65047a5-e824-4cf2-b4fa-be3c72d58102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:48.546507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65047a5-e824-4cf2-b4fa-be3c72d58102 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.546778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65047a5-e824-4cf2-b4fa-be3c72d58102 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.547047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65047a5-e824-4cf2-b4fa-be3c72d58102 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.548290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65047a5-e824-4cf2-b4fa-be3c72d58102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:48.549917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65047a5-e824-4cf2-b4fa-be3c72d58102 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:48.551792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 22/42] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:48.559998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65047a5-e824-4cf2-b4fa-be3c72d58102 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:48.570107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:48.579145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b227-799b-43ca-ba58-2b1a02e4a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:48.579799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b227-799b-43ca-ba58-2b1a02e4a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.583801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b227-799b-43ca-ba58-2b1a02e4a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.583801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8b227-799b-43ca-ba58-2b1a02e4a8c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.583801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8b227-799b-43ca-ba58-2b1a02e4a8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:48.583801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8b227-799b-43ca-ba58-2b1a02e4a8c7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:48.589013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:48.590016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b227-799b-43ca-ba58-2b1a02e4a8c7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:48.647332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:48.684570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65047a5-e824-4cf2-b4fa-be3c72d58102 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:48.702366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8b227-799b-43ca-ba58-2b1a02e4a8c7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:48.720064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f7155-d30f-4f02-9e0d-a25eb6dfa828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:48.720723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f7155-d30f-4f02-9e0d-a25eb6dfa828 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.721034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f7155-d30f-4f02-9e0d-a25eb6dfa828 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.721312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f7155-d30f-4f02-9e0d-a25eb6dfa828 None admin] PATH_INFO: `/v3/domains/default/users/de668eb3aa574c6fb312d4e0c57de17b/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.723562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f7155-d30f-4f02-9e0d-a25eb6dfa828 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=de668eb3aa574c6fb312d4e0c57de17b, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:48.725048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f7155-d30f-4f02-9e0d-a25eb6dfa828 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:48.737496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6aec2-46cc-434d-b384-745b8ea53e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:48.738109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6aec2-46cc-434d-b384-745b8ea53e0f None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.744006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6aec2-46cc-434d-b384-745b8ea53e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.744006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6aec2-46cc-434d-b384-745b8ea53e0f None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.744006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6aec2-46cc-434d-b384-745b8ea53e0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:48.744006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6aec2-46cc-434d-b384-745b8ea53e0f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:48.828458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 23/44] 10.222.0.39 () {58 vars in 1361 bytes} [Mon Sep 5 12:10:48 2022] PUT /identity/v3/domains/default/users/de668eb3aa574c6fb312d4e0c57de17b/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:10:48.829325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f7155-d30f-4f02-9e0d-a25eb6dfa828 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:48.875857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:10:48 2022] POST /identity/v3/projects => generated 312 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:10:48.917961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:48.965143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f7155-d30f-4f02-9e0d-a25eb6dfa828 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:49.004850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bc5f9-1924-40da-95c6-73c553573086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:49.005523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc5f9-1924-40da-95c6-73c553573086 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:49.005812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc5f9-1924-40da-95c6-73c553573086 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:49.006094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bc5f9-1924-40da-95c6-73c553573086 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:49.006821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc5f9-1924-40da-95c6-73c553573086 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:49.008249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bc5f9-1924-40da-95c6-73c553573086 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:49.069495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Sep 5 12:10:48 2022] POST /identity/v3/roles => generated 223 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:10:50.762925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219fd8-28f6-4fdc-9396-f5c4e4502c6a None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:50.764053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219fd8-28f6-4fdc-9396-f5c4e4502c6a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:50.764053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219fd8-28f6-4fdc-9396-f5c4e4502c6a None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:50.765392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 23/47] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:50.770521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d0fa8-3381-4400-9496-9353f956afd3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:50.770949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d0fa8-3381-4400-9496-9353f956afd3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:50.771075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d0fa8-3381-4400-9496-9353f956afd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:50.790157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9d9d0fa8-3381-4400-9496-9353f956afd3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:50.791354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9d9d0fa8-3381-4400-9496-9353f956afd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:50.817817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b603a-d51a-4866-b5e4-23e2e533fe02 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:50.818121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b603a-d51a-4866-b5e4-23e2e533fe02 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:50.818402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b603a-d51a-4866-b5e4-23e2e533fe02 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:50.819739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 24/48] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:50.824682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b008-d2bf-4593-bd6e-e693e9117abf None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:50.825002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b008-d2bf-4593-bd6e-e693e9117abf None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:50.825292 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b008-d2bf-4593-bd6e-e693e9117abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:50.861072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 25/49] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:10:50.948775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6097b008-d2bf-4593-bd6e-e693e9117abf None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:50.950375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6097b008-d2bf-4593-bd6e-e693e9117abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:51.017582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 25/50] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:10:51.127669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d0fa8-3381-4400-9496-9353f956afd3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:51.183386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:51.227708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d0fa8-3381-4400-9496-9353f956afd3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:51.261413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a894038-832c-49fb-8839-af28b245dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:51.262050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894038-832c-49fb-8839-af28b245dd90 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:51.262336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894038-832c-49fb-8839-af28b245dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:51.262615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a894038-832c-49fb-8839-af28b245dd90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:51.274473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a894038-832c-49fb-8839-af28b245dd90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2a894038-832c-49fb-8839-af28b245dd90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:10:51.279629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:51.280632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:10:51.281933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 26/51] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:10:51.286526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097b008-d2bf-4593-bd6e-e693e9117abf None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:51.291713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a894038-832c-49fb-8839-af28b245dd90 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:51.316537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:51.396297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097b008-d2bf-4593-bd6e-e693e9117abf None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:51.432100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:51.432739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:51.433053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:51.433329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:51.434013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:51.434311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:51.436343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:51.449622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 26/52] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:51.456561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:51.508785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a894038-832c-49fb-8839-af28b245dd90 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:51.525633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:51.543289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61392b-60e1-4a37-8eae-abc8b11419ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:51.543936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61392b-60e1-4a37-8eae-abc8b11419ce None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:51.544222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61392b-60e1-4a37-8eae-abc8b11419ce None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:51.544501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61392b-60e1-4a37-8eae-abc8b11419ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:51.546220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61392b-60e1-4a37-8eae-abc8b11419ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:51.546884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:51.547810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61392b-60e1-4a37-8eae-abc8b11419ce None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:51.549429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:51.555292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61392b-60e1-4a37-8eae-abc8b11419ce None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:51.558902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b3a06-8c7c-4d26-996f-cc0311e31e31 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:51.593114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0598-576d-4f5b-9f1f-a10a744c6709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:51.593762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0598-576d-4f5b-9f1f-a10a744c6709 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:51.594050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0598-576d-4f5b-9f1f-a10a744c6709 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:51.594326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f0598-576d-4f5b-9f1f-a10a744c6709 None admin] PATH_INFO: `/v3/users/de668eb3aa574c6fb312d4e0c57de17b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:51.595491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f0598-576d-4f5b-9f1f-a10a744c6709 None admin] RBAC: Authorizing `identity:get_user(user_id=de668eb3aa574c6fb312d4e0c57de17b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:51.596978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f0598-576d-4f5b-9f1f-a10a744c6709 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:51.598623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 27/54] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:10:51 2022] GET /identity/v3/users/de668eb3aa574c6fb312d4e0c57de17b => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:51.604178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0598-576d-4f5b-9f1f-a10a744c6709 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:51.656500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61392b-60e1-4a37-8eae-abc8b11419ce None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:51.693920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7887-70be-49ee-85bf-460feb17a6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:51.694569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7887-70be-49ee-85bf-460feb17a6f0 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:51.694853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7887-70be-49ee-85bf-460feb17a6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:51.695132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7887-70be-49ee-85bf-460feb17a6f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:51.695796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7887-70be-49ee-85bf-460feb17a6f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:51.697289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7887-70be-49ee-85bf-460feb17a6f0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:51.712101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f0598-576d-4f5b-9f1f-a10a744c6709 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:51.747359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cbfc7-124c-4114-8c0c-5d4b3d416eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:51.748617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cbfc7-124c-4114-8c0c-5d4b3d416eef None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:51.748903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cbfc7-124c-4114-8c0c-5d4b3d416eef None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:51.749207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cbfc7-124c-4114-8c0c-5d4b3d416eef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:51.750385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cbfc7-124c-4114-8c0c-5d4b3d416eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:51.751935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cbfc7-124c-4114-8c0c-5d4b3d416eef None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:51.753576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:51.759477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cbfc7-124c-4114-8c0c-5d4b3d416eef None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:51.760259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 28/56] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Sep 5 12:10:51 2022] POST /identity/v3/projects => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:10:51.790915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:51.879803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cbfc7-124c-4114-8c0c-5d4b3d416eef None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:51.916499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed8a87-2bfd-4cc0-bf7a-5cdea6b92ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:51.917201 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed8a87-2bfd-4cc0-bf7a-5cdea6b92ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:51.917490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed8a87-2bfd-4cc0-bf7a-5cdea6b92ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:51.917769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed8a87-2bfd-4cc0-bf7a-5cdea6b92ab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:51.918507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed8a87-2bfd-4cc0-bf7a-5cdea6b92ab0 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.domain.id=default, user.id=de668eb3aa574c6fb312d4e0c57de17b) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:51.918824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed8a87-2bfd-4cc0-bf7a-5cdea6b92ab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:51.920335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed8a87-2bfd-4cc0-bf7a-5cdea6b92ab0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:51.927373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Sep 5 12:10:51 2022] GET /identity/v3/role_assignments?user.id=de668eb3aa574c6fb312d4e0c57de17b&scope.domain.id=default&role.id=41491b52194f43e2902307fb86036726 => generated 530 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:53.701471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f2bd-5a7e-4862-a044-e47302140c32 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:53.701996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f2bd-5a7e-4862-a044-e47302140c32 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:53.702080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61f2bd-5a7e-4862-a044-e47302140c32 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:53.703377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 29/58] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:53.708408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3289787-a8f8-421c-bba2-aba167a5bc91 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:53.708869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3289787-a8f8-421c-bba2-aba167a5bc91 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:53.708979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3289787-a8f8-421c-bba2-aba167a5bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:53.726608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a3289787-a8f8-421c-bba2-aba167a5bc91 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:53.727780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a3289787-a8f8-421c-bba2-aba167a5bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:53.793403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:10:54.065713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f2bd-5a7e-4862-a044-e47302140c32 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:54.100706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:54.168517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61f2bd-5a7e-4862-a044-e47302140c32 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:54.201423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c54433-5818-4088-a02a-287c6dcb2734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:54.202048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c54433-5818-4088-a02a-287c6dcb2734 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:54.202333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c54433-5818-4088-a02a-287c6dcb2734 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:54.202611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c54433-5818-4088-a02a-287c6dcb2734 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:54.203727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c54433-5818-4088-a02a-287c6dcb2734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:54.205197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c54433-5818-4088-a02a-287c6dcb2734 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:54.206755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 30/60] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:54.212522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3289787-a8f8-421c-bba2-aba167a5bc91 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:54.230846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:54.310240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3289787-a8f8-421c-bba2-aba167a5bc91 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:54.343096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ecf13-6af9-41c9-b2bf-17d796403c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:54.343640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecf13-6af9-41c9-b2bf-17d796403c3b None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:54.343926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecf13-6af9-41c9-b2bf-17d796403c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:54.344200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ecf13-6af9-41c9-b2bf-17d796403c3b None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:54.344854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ecf13-6af9-41c9-b2bf-17d796403c3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:54.346362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ecf13-6af9-41c9-b2bf-17d796403c3b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:54.432861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 31/61] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:10:54 2022] POST /identity/v3/users => generated 275 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:10:57.271885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0ff0-6311-46ee-8b21-97f8785e7d6c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:57.271885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0ff0-6311-46ee-8b21-97f8785e7d6c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:57.271885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e0ff0-6311-46ee-8b21-97f8785e7d6c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:57.271885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 31/62] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:57.278366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45160-80df-42c2-84a0-21b964bfff9c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:57.279714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45160-80df-42c2-84a0-21b964bfff9c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:57.280184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f45160-80df-42c2-84a0-21b964bfff9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:57.304647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a1f45160-80df-42c2-84a0-21b964bfff9c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:57.311592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a1f45160-80df-42c2-84a0-21b964bfff9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:57.396839 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 32/63] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:10:57.594980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1b79-5ec8-466c-ad74-6dff6a6d87c8 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:57.595319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1b79-5ec8-466c-ad74-6dff6a6d87c8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:57.595535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae1b79-5ec8-466c-ad74-6dff6a6d87c8 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:57.597109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 32/64] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:57.611159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042456e0-707a-43f0-aefc-c572f4017349 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:57.611452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042456e0-707a-43f0-aefc-c572f4017349 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:57.611733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042456e0-707a-43f0-aefc-c572f4017349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:57.621063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:57.632508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-042456e0-707a-43f0-aefc-c572f4017349 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:57.633724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-042456e0-707a-43f0-aefc-c572f4017349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:57.722688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 33/65] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:10:57.734692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1b79-5ec8-466c-ad74-6dff6a6d87c8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:57.868181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae1b79-5ec8-466c-ad74-6dff6a6d87c8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:57.874834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae6ba-3069-4718-8cf4-d5e4e8f7b847 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:57.875122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae6ba-3069-4718-8cf4-d5e4e8f7b847 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:57.875397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae6ba-3069-4718-8cf4-d5e4e8f7b847 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:57.876746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 34/66] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:57.878437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:57.882126 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b28af9-3d64-450a-bfa3-4c6b157c9b08 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:57.882408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b28af9-3d64-450a-bfa3-4c6b157c9b08 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:57.882684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b28af9-3d64-450a-bfa3-4c6b157c9b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:57.905815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-45b28af9-3d64-450a-bfa3-4c6b157c9b08 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:57.907844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-45b28af9-3d64-450a-bfa3-4c6b157c9b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:57.945374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37788aa4-f20b-4e09-aa9a-673e0be4bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:57.947274 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37788aa4-f20b-4e09-aa9a-673e0be4bba2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:57.947869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37788aa4-f20b-4e09-aa9a-673e0be4bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:57.949461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37788aa4-f20b-4e09-aa9a-673e0be4bba2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:57.967167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37788aa4-f20b-4e09-aa9a-673e0be4bba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-37788aa4-f20b-4e09-aa9a-673e0be4bba2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:10:57.975243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:57.976272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:10:57.977226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:10:57.987645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 33/67] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:10:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:10:57.990765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37788aa4-f20b-4e09-aa9a-673e0be4bba2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.021194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 35/68] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:10:58.025144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b28af9-3d64-450a-bfa3-4c6b157c9b08 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.129414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:58.170546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b28af9-3d64-450a-bfa3-4c6b157c9b08 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.171522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37788aa4-f20b-4e09-aa9a-673e0be4bba2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.208782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b315f67-9a35-4e1a-909b-8ace5504d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:58.210079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b315f67-9a35-4e1a-909b-8ace5504d7bc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.210781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b315f67-9a35-4e1a-909b-8ace5504d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.211473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b315f67-9a35-4e1a-909b-8ace5504d7bc None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.213023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b315f67-9a35-4e1a-909b-8ace5504d7bc None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:58.213786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b315f67-9a35-4e1a-909b-8ace5504d7bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:58.215786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b315f67-9a35-4e1a-909b-8ace5504d7bc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:58.226281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b95c1-c713-4851-aab1-3792e452abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:58.226935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b95c1-c713-4851-aab1-3792e452abde None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.227229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b95c1-c713-4851-aab1-3792e452abde None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.227512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b95c1-c713-4851-aab1-3792e452abde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.230104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:10:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:10:58.231533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dedc13-62d9-4797-a435-f1b561ec3ddd None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.232527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dedc13-62d9-4797-a435-f1b561ec3ddd None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.233064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dedc13-62d9-4797-a435-f1b561ec3ddd None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.234440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 35/70] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:58.239772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b64a-3d88-41c4-b0b2-2585145061dc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.239926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b95c1-c713-4851-aab1-3792e452abde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:10:58.240378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b64a-3d88-41c4-b0b2-2585145061dc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.240802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b64a-3d88-41c4-b0b2-2585145061dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-513b95c1-c713-4851-aab1-3792e452abde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:10:58.244816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:58.245854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:10:58.246806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:10:58.247554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b95c1-c713-4851-aab1-3792e452abde None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.263534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2f87b64a-3d88-41c4-b0b2-2585145061dc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:58.265083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2f87b64a-3d88-41c4-b0b2-2585145061dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:58.288334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:58.340301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 36/72] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:10:58.341238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b64a-3d88-41c4-b0b2-2585145061dc None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.366127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b95c1-c713-4851-aab1-3792e452abde None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.390838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:58.405818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3af49f-e63f-4b32-b1e9-623520911001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:58.407156 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af49f-e63f-4b32-b1e9-623520911001 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.407906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af49f-e63f-4b32-b1e9-623520911001 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.408361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3af49f-e63f-4b32-b1e9-623520911001 None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.427265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3af49f-e63f-4b32-b1e9-623520911001 None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:58.429507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3af49f-e63f-4b32-b1e9-623520911001 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:58.431661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:10:58 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:58.433651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54679ed-7f0e-42e9-8258-1f9033ce9e76 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.434404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54679ed-7f0e-42e9-8258-1f9033ce9e76 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.434882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54679ed-7f0e-42e9-8258-1f9033ce9e76 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.437520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 38/74] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:10:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:58.438717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54679ed-7f0e-42e9-8258-1f9033ce9e76 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.446521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b64a-3d88-41c4-b0b2-2585145061dc None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.483732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:58.484514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.484801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.485157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.485952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:58.486325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:58.487835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:58.497253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:58.498216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.519578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:58.547695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54679ed-7f0e-42e9-8258-1f9033ce9e76 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.586616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d0f53-b80e-42de-8988-157a17291915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:58.587259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0f53-b80e-42de-8988-157a17291915 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.587540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0f53-b80e-42de-8988-157a17291915 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.587818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0f53-b80e-42de-8988-157a17291915 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.598316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0f53-b80e-42de-8988-157a17291915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-d94d0f53-b80e-42de-8988-157a17291915 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:10:58.603267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:58.604332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:10:58.605327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 39/76] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:10:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:10:58.606125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50044-b2df-48d4-a245-1cc37ec07128 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.606125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50044-b2df-48d4-a245-1cc37ec07128 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.606125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50044-b2df-48d4-a245-1cc37ec07128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.615472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230768e1-d3ee-4e7c-b451-cceb3c50aef2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.627634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c3a50044-b2df-48d4-a245-1cc37ec07128 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:58.629010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c3a50044-b2df-48d4-a245-1cc37ec07128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:58.652647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d749-606e-4215-b7b4-178263a48890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:58.653205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d749-606e-4215-b7b4-178263a48890 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.653485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d749-606e-4215-b7b4-178263a48890 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.654290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6d749-606e-4215-b7b4-178263a48890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.665637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:58.700388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 40/77] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:10:58.702158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50044-b2df-48d4-a245-1cc37ec07128 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.742474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6d749-606e-4215-b7b4-178263a48890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:58.743991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6d749-606e-4215-b7b4-178263a48890 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:58.768337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:58.808556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50044-b2df-48d4-a245-1cc37ec07128 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.847779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6d557-5789-419c-823d-5f425d611219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:58.848662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6d557-5789-419c-823d-5f425d611219 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:58.848956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6d557-5789-419c-823d-5f425d611219 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:58.849462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6d557-5789-419c-823d-5f425d611219 None admin] PATH_INFO: `/v3/users/de668eb3aa574c6fb312d4e0c57de17b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:58.851211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6d557-5789-419c-823d-5f425d611219 None admin] RBAC: Authorizing `identity:get_user(user_id=de668eb3aa574c6fb312d4e0c57de17b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:58.853186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6d557-5789-419c-823d-5f425d611219 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:58.859651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 41/78] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:10:58 2022] GET /identity/v3/users/de668eb3aa574c6fb312d4e0c57de17b => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:58.859651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6d557-5789-419c-823d-5f425d611219 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.859839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 38/79] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:10:58.860337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d749-606e-4215-b7b4-178263a48890 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:58.911985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:58.972320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6d749-606e-4215-b7b4-178263a48890 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.978744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6d557-5789-419c-823d-5f425d611219 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:58.990024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.007509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe80ee-7802-4b28-a00c-724c93ae47aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.008148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe80ee-7802-4b28-a00c-724c93ae47aa None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.008435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe80ee-7802-4b28-a00c-724c93ae47aa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.008714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe80ee-7802-4b28-a00c-724c93ae47aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.009874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe80ee-7802-4b28-a00c-724c93ae47aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.011341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe80ee-7802-4b28-a00c-724c93ae47aa None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.012918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 39/80] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:59.013801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe80ee-7802-4b28-a00c-724c93ae47aa None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.014635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.015253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.015611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.015908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.016571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:59.016878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.018579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.027533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 42/81] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:10:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:59.028344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.120444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe80ee-7802-4b28-a00c-724c93ae47aa None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.129570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22e092-f88c-4641-8b60-791e9fe12e06 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.131111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.154162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf44565-f7a5-4150-b1e8-2059ed75f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.154774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44565-f7a5-4150-b1e8-2059ed75f454 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.155057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44565-f7a5-4150-b1e8-2059ed75f454 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.155328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44565-f7a5-4150-b1e8-2059ed75f454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.163468 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b651b-7bbe-4d8a-8625-c62b82d36646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.164514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b651b-7bbe-4d8a-8625-c62b82d36646 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.165139 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b651b-7bbe-4d8a-8625-c62b82d36646 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.165890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b651b-7bbe-4d8a-8625-c62b82d36646 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.167075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b651b-7bbe-4d8a-8625-c62b82d36646 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.168543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b651b-7bbe-4d8a-8625-c62b82d36646 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.171007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 43/82] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:59.171661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b651b-7bbe-4d8a-8625-c62b82d36646 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.214731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.226852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf44565-f7a5-4150-b1e8-2059ed75f454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.228397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf44565-f7a5-4150-b1e8-2059ed75f454 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.270239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b651b-7bbe-4d8a-8625-c62b82d36646 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.303746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11785cad-f45b-41b1-ae32-facec040b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.304378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11785cad-f45b-41b1-ae32-facec040b692 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.304667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11785cad-f45b-41b1-ae32-facec040b692 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.304970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11785cad-f45b-41b1-ae32-facec040b692 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.316005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11785cad-f45b-41b1-ae32-facec040b692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-11785cad-f45b-41b1-ae32-facec040b692 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:10:59.321385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:10:59.322245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:10:59.323030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 44/83] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:10:59.323708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11785cad-f45b-41b1-ae32-facec040b692 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.333089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 40/84] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:10:59.333928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf44565-f7a5-4150-b1e8-2059ed75f454 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.356703 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.418817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.428131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11785cad-f45b-41b1-ae32-facec040b692 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.434562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf44565-f7a5-4150-b1e8-2059ed75f454 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.463534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea736fc-7499-4566-ad70-c44fe3d5975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.464159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea736fc-7499-4566-ad70-c44fe3d5975a None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.464443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea736fc-7499-4566-ad70-c44fe3d5975a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.464724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea736fc-7499-4566-ad70-c44fe3d5975a None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.465415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea736fc-7499-4566-ad70-c44fe3d5975a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.466932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea736fc-7499-4566-ad70-c44fe3d5975a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.470053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da8c0-a2ae-4a6b-8fef-56278633a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.470693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da8c0-a2ae-4a6b-8fef-56278633a982 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.470979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da8c0-a2ae-4a6b-8fef-56278633a982 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.471257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77da8c0-a2ae-4a6b-8fef-56278633a982 None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.472403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77da8c0-a2ae-4a6b-8fef-56278633a982 None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.473880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77da8c0-a2ae-4a6b-8fef-56278633a982 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.475655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 41/85] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:59.477233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da8c0-a2ae-4a6b-8fef-56278633a982 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.541527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 45/86] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:10:59 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:10:59.542413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea736fc-7499-4566-ad70-c44fe3d5975a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.590657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77da8c0-a2ae-4a6b-8fef-56278633a982 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.630027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.630650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.630949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.631243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.631972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] RBAC: Adding query filter params (role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=1a563089af444e2c9c4d6f29feb1630b, user.id=cf96e05ed7054e0e8c8392a93922e1d0) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:59.632285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.633810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.652995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 42/87] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/role_assignments?user.id=cf96e05ed7054e0e8c8392a93922e1d0&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:59.652995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.653782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.674479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea736fc-7499-4566-ad70-c44fe3d5975a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.679705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.729821 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.730392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.730679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.730955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.732323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:10:59.732594 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.736827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.744911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 46/88] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:59.745811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.800849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fafa3-95fc-4bb4-a6d6-8f5236d90363 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.845074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597072e7-67dc-4c70-93e6-df4ce1cf9491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.845732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597072e7-67dc-4c70-93e6-df4ce1cf9491 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.846014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597072e7-67dc-4c70-93e6-df4ce1cf9491 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.846286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597072e7-67dc-4c70-93e6-df4ce1cf9491 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.847449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597072e7-67dc-4c70-93e6-df4ce1cf9491 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.849200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597072e7-67dc-4c70-93e6-df4ce1cf9491 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.852315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 43/89] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:10:59.853241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597072e7-67dc-4c70-93e6-df4ce1cf9491 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.888489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5cf1a2-5a43-44a4-bc48-a87611ae8daa None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.931262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ed4f7-b0fe-43f9-9c00-9f227a639121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.931892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed4f7-b0fe-43f9-9c00-9f227a639121 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.932178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed4f7-b0fe-43f9-9c00-9f227a639121 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.932479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ed4f7-b0fe-43f9-9c00-9f227a639121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.953367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.987027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:00.003165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597072e7-67dc-4c70-93e6-df4ce1cf9491 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:00.019044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ed4f7-b0fe-43f9-9c00-9f227a639121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:00.020535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ed4f7-b0fe-43f9-9c00-9f227a639121 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:00.052004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2ab23-4677-4300-9c37-1edee898af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:00.052928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2ab23-4677-4300-9c37-1edee898af02 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:00.053246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2ab23-4677-4300-9c37-1edee898af02 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:00.053777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2ab23-4677-4300-9c37-1edee898af02 None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:00.054990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2ab23-4677-4300-9c37-1edee898af02 None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:00.057218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2ab23-4677-4300-9c37-1edee898af02 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:00.060891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 44/90] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:00.061557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2ab23-4677-4300-9c37-1edee898af02 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:00.145540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 47/91] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:00.146795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ed4f7-b0fe-43f9-9c00-9f227a639121 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:00.205503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:00.261144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ed4f7-b0fe-43f9-9c00-9f227a639121 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:00.271511 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2ab23-4677-4300-9c37-1edee898af02 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:00.299381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fe5f7-3415-4e33-83a9-c1a09fde3e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:00.300008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fe5f7-3415-4e33-83a9-c1a09fde3e31 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:00.300302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fe5f7-3415-4e33-83a9-c1a09fde3e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:00.300582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fe5f7-3415-4e33-83a9-c1a09fde3e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:00.331808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:00.332839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:00.333344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:00.334354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:00.335439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=1a563089af444e2c9c4d6f29feb1630b, user.id=de668eb3aa574c6fb312d4e0c57de17b) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:00.335988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:00.337828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:00.356195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 45/92] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:00 2022] GET /identity/v3/role_assignments?user.id=de668eb3aa574c6fb312d4e0c57de17b&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=41491b52194f43e2902307fb86036726 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:00.357447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:00.377192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fe5f7-3415-4e33-83a9-c1a09fde3e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:00.379194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fe5f7-3415-4e33-83a9-c1a09fde3e31 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:00.397073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:00.441340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:00.514303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 48/93] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:00.519641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fe5f7-3415-4e33-83a9-c1a09fde3e31 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:00.560860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b07b0-c95a-4374-8d0f-02d81ba52356 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:00.605987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdf575-9100-4f16-92fb-69eb9173a2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:00.608823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdf575-9100-4f16-92fb-69eb9173a2fc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:00.609324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdf575-9100-4f16-92fb-69eb9173a2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:00.609785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdf575-9100-4f16-92fb-69eb9173a2fc None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:00.612299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdf575-9100-4f16-92fb-69eb9173a2fc None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:00.615432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdf575-9100-4f16-92fb-69eb9173a2fc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:00.621508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 46/94] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:00 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:00.628025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdf575-9100-4f16-92fb-69eb9173a2fc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:00.705302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fe5f7-3415-4e33-83a9-c1a09fde3e31 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:00.780321 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0f92-3ff0-42ed-879a-2aa040bd938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:00.781277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0f92-3ff0-42ed-879a-2aa040bd938c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:00.781761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0f92-3ff0-42ed-879a-2aa040bd938c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:00.782176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0f92-3ff0-42ed-879a-2aa040bd938c None admin] PATH_INFO: `/v3/projects/98be5dac45ed41fa81df5c849ed3714c` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:00.783679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d0f92-3ff0-42ed-879a-2aa040bd938c None admin] RBAC: Authorizing `identity:get_project(project_id=98be5dac45ed41fa81df5c849ed3714c)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:00.787303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d0f92-3ff0-42ed-879a-2aa040bd938c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:00.792114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 49/95] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:00 2022] GET /identity/v3/projects/98be5dac45ed41fa81df5c849ed3714c => generated 312 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:00.798619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0f92-3ff0-42ed-879a-2aa040bd938c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:00.813298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:00.843280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:00.847505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdf575-9100-4f16-92fb-69eb9173a2fc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:00.915124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca917-1a39-4402-83b5-09d829a6f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:00.915746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca917-1a39-4402-83b5-09d829a6f274 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:00.916030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca917-1a39-4402-83b5-09d829a6f274 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:00.916308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca917-1a39-4402-83b5-09d829a6f274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:00.917088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cca917-1a39-4402-83b5-09d829a6f274 None admin] RBAC: Adding query filter params (role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=1a563089af444e2c9c4d6f29feb1630b, user.id=cf96e05ed7054e0e8c8392a93922e1d0) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:00.917478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cca917-1a39-4402-83b5-09d829a6f274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:00.918943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cca917-1a39-4402-83b5-09d829a6f274 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:00.930943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 47/96] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:00 2022] GET /identity/v3/role_assignments?user.id=cf96e05ed7054e0e8c8392a93922e1d0&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=d278ed91749c4adf9b130d08698e7933 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:01.040279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0f92-3ff0-42ed-879a-2aa040bd938c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:01.093912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713b98-01e4-479f-859a-080c44a2569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:01.094571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713b98-01e4-479f-859a-080c44a2569c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:01.094864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713b98-01e4-479f-859a-080c44a2569c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:01.095150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713b98-01e4-479f-859a-080c44a2569c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:01.096477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713b98-01e4-479f-859a-080c44a2569c None admin] RBAC: Adding query filter params (role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=98be5dac45ed41fa81df5c849ed3714c, user.id=cf96e05ed7054e0e8c8392a93922e1d0) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:01.097005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713b98-01e4-479f-859a-080c44a2569c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:01.099435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713b98-01e4-479f-859a-080c44a2569c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:01.105771 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 50/97] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:00 2022] GET /identity/v3/role_assignments?user.id=cf96e05ed7054e0e8c8392a93922e1d0&scope.project.id=98be5dac45ed41fa81df5c849ed3714c&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:01.988765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d6c61-002f-4658-8e90-9fd7b93ef56a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:01.989347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d6c61-002f-4658-8e90-9fd7b93ef56a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:01.989347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d6c61-002f-4658-8e90-9fd7b93ef56a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:01.990949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 48/98] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:01.996284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463575-f4e0-4114-afaf-79be69c12d3c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:01.996762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463575-f4e0-4114-afaf-79be69c12d3c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:01.996863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463575-f4e0-4114-afaf-79be69c12d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:02.026923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7a463575-f4e0-4114-afaf-79be69c12d3c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:02.028153 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7a463575-f4e0-4114-afaf-79be69c12d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:02.112405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 51/99] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:02.402521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d6c61-002f-4658-8e90-9fd7b93ef56a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:02.486750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204437d1-adf9-4b86-9720-f1b4c5f6f4f8 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:02.487064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204437d1-adf9-4b86-9720-f1b4c5f6f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:02.487349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204437d1-adf9-4b86-9720-f1b4c5f6f4f8 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:02.489036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 52/100] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:11:02.494581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647486c-35e9-4e0f-a2c4-10f0d563c666 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:02.495166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647486c-35e9-4e0f-a2c4-10f0d563c666 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:02.495645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647486c-35e9-4e0f-a2c4-10f0d563c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:02.515973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4647486c-35e9-4e0f-a2c4-10f0d563c666 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:02.517597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4647486c-35e9-4e0f-a2c4-10f0d563c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:02.521333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:02.558389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d6c61-002f-4658-8e90-9fd7b93ef56a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:02.591878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 53/101] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:02.620979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2d8e-7637-4c16-913d-c6b8baf71267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:02.621971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2d8e-7637-4c16-913d-c6b8baf71267 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:02.622502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2d8e-7637-4c16-913d-c6b8baf71267 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:02.622978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f2d8e-7637-4c16-913d-c6b8baf71267 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:02.641215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f2d8e-7637-4c16-913d-c6b8baf71267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:02.645956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecdd83-36c4-4dcc-b1af-a06c28254a90 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:02.646472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecdd83-36c4-4dcc-b1af-a06c28254a90 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:02.646972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecdd83-36c4-4dcc-b1af-a06c28254a90 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:02.648520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 54/102] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-455f2d8e-7637-4c16-913d-c6b8baf71267 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:02.651811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:02.652698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:02.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:02.656361 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 49/103] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:02.662192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4d8b-54ce-418b-ade6-7fe193fc6c68 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:02.662718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4d8b-54ce-418b-ade6-7fe193fc6c68 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:02.663239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4d8b-54ce-418b-ade6-7fe193fc6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:02.669070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2d8e-7637-4c16-913d-c6b8baf71267 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:02.696290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a3ec4d8b-54ce-418b-ade6-7fe193fc6c68 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:02.698072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a3ec4d8b-54ce-418b-ade6-7fe193fc6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:02.707290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:02.842845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 55/104] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:02.863333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f2d8e-7637-4c16-913d-c6b8baf71267 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:02.899028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:02.899667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:02.900224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:02.900507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:02.901241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:02.901553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:02.903035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:02.914520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 50/105] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:02.920259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4d8b-54ce-418b-ade6-7fe193fc6c68 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:02.993258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:03.026694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4d8b-54ce-418b-ade6-7fe193fc6c68 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:03.062816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccecea-ff11-4537-a238-0cad0bcc7004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:03.063518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccecea-ff11-4537-a238-0cad0bcc7004 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.063804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccecea-ff11-4537-a238-0cad0bcc7004 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.064085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccecea-ff11-4537-a238-0cad0bcc7004 None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.065320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccecea-ff11-4537-a238-0cad0bcc7004 None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:03.066794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccecea-ff11-4537-a238-0cad0bcc7004 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:03.068773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 56/106] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:02 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:03.074347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:03.147205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:03.182534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e1020-9476-4e2f-b713-f4e2b25c2352 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:03.227176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6d111-3811-4c75-9642-1aa1842e8a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:03.227827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6d111-3811-4c75-9642-1aa1842e8a5b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.228117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6d111-3811-4c75-9642-1aa1842e8a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.228454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6d111-3811-4c75-9642-1aa1842e8a5b None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.229651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6d111-3811-4c75-9642-1aa1842e8a5b None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:03.231108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6d111-3811-4c75-9642-1aa1842e8a5b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:03.233002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 51/107] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:03 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:03.238617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccecea-ff11-4537-a238-0cad0bcc7004 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:03.249558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6d111-3811-4c75-9642-1aa1842e8a5b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:03.392735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6d111-3811-4c75-9642-1aa1842e8a5b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:03.434593 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08476b0-7e51-4846-adb0-699aea20d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:03.435705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08476b0-7e51-4846-adb0-699aea20d458 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.435994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08476b0-7e51-4846-adb0-699aea20d458 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.436269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08476b0-7e51-4846-adb0-699aea20d458 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.442970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccecea-ff11-4537-a238-0cad0bcc7004 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:03.457455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:03.463407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08476b0-7e51-4846-adb0-699aea20d458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f08476b0-7e51-4846-adb0-699aea20d458 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:03.470295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:03.481085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 52/108] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:03.482411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08476b0-7e51-4846-adb0-699aea20d458 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:03.512680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98761764-b584-4766-a041-298d88a3938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:03.513414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761764-b584-4766-a041-298d88a3938b None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.513700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761764-b584-4766-a041-298d88a3938b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.513980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98761764-b584-4766-a041-298d88a3938b None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b/users/cf96e05ed7054e0e8c8392a93922e1d0/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.519053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98761764-b584-4766-a041-298d88a3938b None admin] RBAC: Authorizing `identity:create_grant(project_id=1a563089af444e2c9c4d6f29feb1630b, user_id=cf96e05ed7054e0e8c8392a93922e1d0, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:03.520522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98761764-b584-4766-a041-298d88a3938b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:03.571869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:03.579386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 57/109] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:03 2022] PUT /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b/users/cf96e05ed7054e0e8c8392a93922e1d0/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:03.579386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98761764-b584-4766-a041-298d88a3938b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:03.685614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08476b0-7e51-4846-adb0-699aea20d458 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:03.749399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656c4c8-e26c-4222-bfdf-aedc71d49679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:03.750383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c4c8-e26c-4222-bfdf-aedc71d49679 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.750818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c4c8-e26c-4222-bfdf-aedc71d49679 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.751252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c4c8-e26c-4222-bfdf-aedc71d49679 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.753334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656c4c8-e26c-4222-bfdf-aedc71d49679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:03.755756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656c4c8-e26c-4222-bfdf-aedc71d49679 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:03.758169 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 53/110] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:03.762182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa136f-2168-44f8-9870-89a445416faa None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.762476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa136f-2168-44f8-9870-89a445416faa None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.764782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa136f-2168-44f8-9870-89a445416faa None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.766199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 54/111] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:03.768099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa136f-2168-44f8-9870-89a445416faa None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:03.802687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98761764-b584-4766-a041-298d88a3938b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:03.857124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a67c8-123b-4842-9779-bec06eed5fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:03.858387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a67c8-123b-4842-9779-bec06eed5fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.859244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a67c8-123b-4842-9779-bec06eed5fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.860057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a67c8-123b-4842-9779-bec06eed5fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.861238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a67c8-123b-4842-9779-bec06eed5fd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:03.861574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a67c8-123b-4842-9779-bec06eed5fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:03.864240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a67c8-123b-4842-9779-bec06eed5fd6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:03.874243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:03.879396 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 58/112] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:03.881033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316192-c0d2-4152-9013-f815c5f93039 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.881555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316192-c0d2-4152-9013-f815c5f93039 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.882037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316192-c0d2-4152-9013-f815c5f93039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.907535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e2316192-c0d2-4152-9013-f815c5f93039 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:03.909796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e2316192-c0d2-4152-9013-f815c5f93039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:03.937760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa136f-2168-44f8-9870-89a445416faa None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:03.977876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269001f-e948-4885-9223-ec523d0c3529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:03.978490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269001f-e948-4885-9223-ec523d0c3529 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:03.978782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269001f-e948-4885-9223-ec523d0c3529 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:03.979063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269001f-e948-4885-9223-ec523d0c3529 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:03.979726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269001f-e948-4885-9223-ec523d0c3529 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:03.981231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269001f-e948-4885-9223-ec523d0c3529 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:03.982438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:03.997040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 59/113] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:03.999736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2316192-c0d2-4152-9013-f815c5f93039 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:04.093182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 55/114] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:11:03 2022] POST /identity/v3/projects => generated 302 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:04.095333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f199ab-5420-495e-b00e-71e2f03886dc None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.095835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f199ab-5420-495e-b00e-71e2f03886dc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.097525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f199ab-5420-495e-b00e-71e2f03886dc None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.099181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 56/115] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:04.105280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1a6e-eaf1-448e-ae61-fb1db78a29e4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.105865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1a6e-eaf1-448e-ae61-fb1db78a29e4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.106345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c1a6e-eaf1-448e-ae61-fb1db78a29e4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.112506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 57/116] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:04.114437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124a9a-fdf8-4365-ba80-ae46a4b062bc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.114950 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124a9a-fdf8-4365-ba80-ae46a4b062bc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.115459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124a9a-fdf8-4365-ba80-ae46a4b062bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.135888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ee124a9a-fdf8-4365-ba80-ae46a4b062bc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:04.137493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ee124a9a-fdf8-4365-ba80-ae46a4b062bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:04.140441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2316192-c0d2-4152-9013-f815c5f93039 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:04.199031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab73d6-3194-4562-962b-aca8bda2eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:04.199606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab73d6-3194-4562-962b-aca8bda2eb58 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.199890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab73d6-3194-4562-962b-aca8bda2eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.200166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab73d6-3194-4562-962b-aca8bda2eb58 None admin] PATH_INFO: `/v3/users/3f61a5d555fa40c7b924347b5e300d2f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.217836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 58/117] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:04.219602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd248b-2aa4-4b5e-9617-cd4477c79a76 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.220133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd248b-2aa4-4b5e-9617-cd4477c79a76 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.220609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd248b-2aa4-4b5e-9617-cd4477c79a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.226247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab73d6-3194-4562-962b-aca8bda2eb58 None admin] RBAC: Authorizing `identity:get_user(user_id=3f61a5d555fa40c7b924347b5e300d2f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:04.227856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab73d6-3194-4562-962b-aca8bda2eb58 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:04.229979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 60/118] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:03 2022] GET /identity/v3/users/3f61a5d555fa40c7b924347b5e300d2f => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:04.236017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab73d6-3194-4562-962b-aca8bda2eb58 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:04.242323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-adbd248b-2aa4-4b5e-9617-cd4477c79a76 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:04.243919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-adbd248b-2aa4-4b5e-9617-cd4477c79a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:04.302071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:04.324563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 59/119] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:04.335280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:04.345333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd248b-2aa4-4b5e-9617-cd4477c79a76 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:04.453886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab73d6-3194-4562-962b-aca8bda2eb58 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:04.491632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd248b-2aa4-4b5e-9617-cd4477c79a76 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:04.528445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e979f8-e21e-447a-a2fd-5fc787486f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:04.529658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e979f8-e21e-447a-a2fd-5fc787486f9b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.529949 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e979f8-e21e-447a-a2fd-5fc787486f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.530230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e979f8-e21e-447a-a2fd-5fc787486f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.543280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11bac2-1969-4953-bdd5-51213a40cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:04.544295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11bac2-1969-4953-bdd5-51213a40cf10 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.544825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11bac2-1969-4953-bdd5-51213a40cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.545356 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11bac2-1969-4953-bdd5-51213a40cf10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.557641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11bac2-1969-4953-bdd5-51213a40cf10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2c11bac2-1969-4953-bdd5-51213a40cf10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:04.563913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:04.564811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:04.565605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:04.569463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 60/120] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:04.569463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11bac2-1969-4953-bdd5-51213a40cf10 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:04.620265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:04.643897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e979f8-e21e-447a-a2fd-5fc787486f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:04.645735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e979f8-e21e-447a-a2fd-5fc787486f9b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:04.680581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11bac2-1969-4953-bdd5-51213a40cf10 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:04.697266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:04.716801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51879298-67a4-45c5-96e7-e28c767e159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:04.717509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51879298-67a4-45c5-96e7-e28c767e159c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.717638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51879298-67a4-45c5-96e7-e28c767e159c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.717914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51879298-67a4-45c5-96e7-e28c767e159c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.728743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51879298-67a4-45c5-96e7-e28c767e159c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-51879298-67a4-45c5-96e7-e28c767e159c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:04.734307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:04.735161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 61/121] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:04.736642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51879298-67a4-45c5-96e7-e28c767e159c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:04.759693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 61/122] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:11:04.761031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e979f8-e21e-447a-a2fd-5fc787486f9b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:04.842934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:04.845719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51879298-67a4-45c5-96e7-e28c767e159c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:04.874337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e979f8-e21e-447a-a2fd-5fc787486f9b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:04.881207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:04.881953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.882336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.882713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.883496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:04.884185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:04.885933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:04.895659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 62/123] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:04.896612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:04.918296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f40782-b786-4cbb-bce9-beba7f274ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:04.919244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f40782-b786-4cbb-bce9-beba7f274ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.919675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f40782-b786-4cbb-bce9-beba7f274ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.920212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f40782-b786-4cbb-bce9-beba7f274ae8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.932841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f40782-b786-4cbb-bce9-beba7f274ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-a4f40782-b786-4cbb-bce9-beba7f274ae8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:04.939009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:04.940038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:04.940810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:04.943304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 62/124] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:04.944481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f40782-b786-4cbb-bce9-beba7f274ae8 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:04.957566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:05.028051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6191352-4fd5-4d24-a2b1-63a179bf7a3c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.061907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f40782-b786-4cbb-bce9-beba7f274ae8 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.073539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.074560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.074855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.075135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.075919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:05.076543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.078371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.089821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 63/125] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.090753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.103105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42129dcf-0994-4994-9a8f-3641798d9165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.104019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42129dcf-0994-4994-9a8f-3641798d9165 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.104603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42129dcf-0994-4994-9a8f-3641798d9165 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.105098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42129dcf-0994-4994-9a8f-3641798d9165 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.107086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42129dcf-0994-4994-9a8f-3641798d9165 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.108748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42129dcf-0994-4994-9a8f-3641798d9165 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.110875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 63/126] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:04 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.112049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42129dcf-0994-4994-9a8f-3641798d9165 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.123293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:05.200632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:05.225264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818ec4-2260-41e3-87a8-871db769b5a6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.225764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42129dcf-0994-4994-9a8f-3641798d9165 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.266064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0864f2-39f7-4f97-a59b-057599270d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.267327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0864f2-39f7-4f97-a59b-057599270d1a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.267838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0864f2-39f7-4f97-a59b-057599270d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.268362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0864f2-39f7-4f97-a59b-057599270d1a None admin] PATH_INFO: `/v3/users/de668eb3aa574c6fb312d4e0c57de17b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.269754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0864f2-39f7-4f97-a59b-057599270d1a None admin] RBAC: Authorizing `identity:get_user(user_id=de668eb3aa574c6fb312d4e0c57de17b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.271720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0864f2-39f7-4f97-a59b-057599270d1a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.272992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.273621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.273910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.274189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.274557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 64/127] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/users/de668eb3aa574c6fb312d4e0c57de17b => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.275237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:05.275553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.276336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0864f2-39f7-4f97-a59b-057599270d1a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.277075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.287702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 64/128] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.289027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.396141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:05.409194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0864f2-39f7-4f97-a59b-057599270d1a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.425860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57addcc3-894f-45a9-a68b-aeccca2c1cf4 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.459154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eebcb9-5a5b-4186-872a-c1f5f553916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.459905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eebcb9-5a5b-4186-872a-c1f5f553916e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.460197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eebcb9-5a5b-4186-872a-c1f5f553916e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.460477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eebcb9-5a5b-4186-872a-c1f5f553916e None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.461688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eebcb9-5a5b-4186-872a-c1f5f553916e None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.463435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eebcb9-5a5b-4186-872a-c1f5f553916e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.464272 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.464889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.465021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 65/129] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.465502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.466348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eebcb9-5a5b-4186-872a-c1f5f553916e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.466503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.467202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] RBAC: Adding query filter params (role.id=e9faf0d531a54b68be17731e1203edf3, scope.project.id=1a563089af444e2c9c4d6f29feb1630b, user.id=3f61a5d555fa40c7b924347b5e300d2f) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:05.467626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.471933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.478392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 65/130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/role_assignments?user.id=3f61a5d555fa40c7b924347b5e300d2f&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=e9faf0d531a54b68be17731e1203edf3 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.479278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.483917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:05.608159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eebcb9-5a5b-4186-872a-c1f5f553916e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.612762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8980ea-dff8-43f7-a29f-dffb30d93b29 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.654380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c1475-e6df-4d1e-a550-2544bc2225a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.655045 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1475-e6df-4d1e-a550-2544bc2225a1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.655339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1475-e6df-4d1e-a550-2544bc2225a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.655442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cdad3-7f04-4685-bc2d-6ed2f94fd2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.655637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1475-e6df-4d1e-a550-2544bc2225a1 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.656138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cdad3-7f04-4685-bc2d-6ed2f94fd2fc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.656431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cdad3-7f04-4685-bc2d-6ed2f94fd2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.656710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cdad3-7f04-4685-bc2d-6ed2f94fd2fc None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.656872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c1475-e6df-4d1e-a550-2544bc2225a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.657945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cdad3-7f04-4685-bc2d-6ed2f94fd2fc None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.658362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c1475-e6df-4d1e-a550-2544bc2225a1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.659400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cdad3-7f04-4685-bc2d-6ed2f94fd2fc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.660224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 66/131] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.660976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c1475-e6df-4d1e-a550-2544bc2225a1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.661363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 66/132] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.674498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cdad3-7f04-4685-bc2d-6ed2f94fd2fc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.698253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:05.795152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c1475-e6df-4d1e-a550-2544bc2225a1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.831056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:05.846245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfab57-41e6-47c7-91a9-aa65f6260fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.847170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfab57-41e6-47c7-91a9-aa65f6260fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.847624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfab57-41e6-47c7-91a9-aa65f6260fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.848032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfab57-41e6-47c7-91a9-aa65f6260fb3 None admin] PATH_INFO: `/v3/projects/98be5dac45ed41fa81df5c849ed3714c` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.849424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfab57-41e6-47c7-91a9-aa65f6260fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=98be5dac45ed41fa81df5c849ed3714c)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.851445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfab57-41e6-47c7-91a9-aa65f6260fb3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.853448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 67/133] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/projects/98be5dac45ed41fa81df5c849ed3714c => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:05.854635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfab57-41e6-47c7-91a9-aa65f6260fb3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.942713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cdad3-7f04-4685-bc2d-6ed2f94fd2fc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.984004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfab57-41e6-47c7-91a9-aa65f6260fb3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.987578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:06.026458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782d1a-58a3-4414-afd2-8de36b3f6e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:06.027561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782d1a-58a3-4414-afd2-8de36b3f6e9b None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:06.028048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782d1a-58a3-4414-afd2-8de36b3f6e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:06.028727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782d1a-58a3-4414-afd2-8de36b3f6e9b None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b/users/de668eb3aa574c6fb312d4e0c57de17b/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:06.031108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782d1a-58a3-4414-afd2-8de36b3f6e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=1a563089af444e2c9c4d6f29feb1630b, user_id=de668eb3aa574c6fb312d4e0c57de17b, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:06.032820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782d1a-58a3-4414-afd2-8de36b3f6e9b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:06.038701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a60b8-3d88-4176-852f-f4184a8f0214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:06.039368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a60b8-3d88-4176-852f-f4184a8f0214 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:06.039656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a60b8-3d88-4176-852f-f4184a8f0214 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:06.039934 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a60b8-3d88-4176-852f-f4184a8f0214 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:06.045307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a60b8-3d88-4176-852f-f4184a8f0214 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:06.045307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a60b8-3d88-4176-852f-f4184a8f0214 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:06.045307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 67/134] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:06.050696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a60b8-3d88-4176-852f-f4184a8f0214 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:06.127268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 68/135] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:05 2022] PUT /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b/users/de668eb3aa574c6fb312d4e0c57de17b/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:06.128110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782d1a-58a3-4414-afd2-8de36b3f6e9b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:06.218826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a60b8-3d88-4176-852f-f4184a8f0214 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:06.292172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1b7f-dea7-4560-9ffd-a768cd38946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:06.293363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1b7f-dea7-4560-9ffd-a768cd38946f None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:06.293938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1b7f-dea7-4560-9ffd-a768cd38946f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:06.294446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1b7f-dea7-4560-9ffd-a768cd38946f None admin] PATH_INFO: `/v3/projects/98be5dac45ed41fa81df5c849ed3714c/users/cf96e05ed7054e0e8c8392a93922e1d0/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:06.297031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b1b7f-dea7-4560-9ffd-a768cd38946f None admin] RBAC: Authorizing `identity:create_grant(project_id=98be5dac45ed41fa81df5c849ed3714c, user_id=cf96e05ed7054e0e8c8392a93922e1d0, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:06.300780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b1b7f-dea7-4560-9ffd-a768cd38946f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:06.337159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782d1a-58a3-4414-afd2-8de36b3f6e9b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:06.355073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:06.362652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 68/136] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:06 2022] PUT /identity/v3/projects/98be5dac45ed41fa81df5c849ed3714c/users/cf96e05ed7054e0e8c8392a93922e1d0/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:06.365769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8d240-5acc-4bfa-bbb8-3a5e08a55a1d None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:06.366656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8d240-5acc-4bfa-bbb8-3a5e08a55a1d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:06.367447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8d240-5acc-4bfa-bbb8-3a5e08a55a1d None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:06.369586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 69/137] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:06.375744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d033f-7d17-47d2-9660-0168bd0248c7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:06.376399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d033f-7d17-47d2-9660-0168bd0248c7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:06.376884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d033f-7d17-47d2-9660-0168bd0248c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:06.401818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-312d033f-7d17-47d2-9660-0168bd0248c7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:06.404003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-312d033f-7d17-47d2-9660-0168bd0248c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:06.407424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4232d-ddbf-471c-95e7-b81db21a80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:06.409124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4232d-ddbf-471c-95e7-b81db21a80bd None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:06.409124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4232d-ddbf-471c-95e7-b81db21a80bd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:06.409124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4232d-ddbf-471c-95e7-b81db21a80bd None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b/users/cf96e05ed7054e0e8c8392a93922e1d0/roles/d278ed91749c4adf9b130d08698e7933` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:06.412862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4232d-ddbf-471c-95e7-b81db21a80bd None admin] RBAC: Authorizing `identity:create_grant(project_id=1a563089af444e2c9c4d6f29feb1630b, user_id=cf96e05ed7054e0e8c8392a93922e1d0, role_id=d278ed91749c4adf9b130d08698e7933)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:06.413884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4232d-ddbf-471c-95e7-b81db21a80bd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:06.484217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 69/138] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:06 2022] PUT /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b/users/cf96e05ed7054e0e8c8392a93922e1d0/roles/d278ed91749c4adf9b130d08698e7933 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:06.491729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 70/139] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:06.681247 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09cc34-1a63-4f88-b70d-f80b7bd9a6f0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:06.681619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09cc34-1a63-4f88-b70d-f80b7bd9a6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:06.681822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09cc34-1a63-4f88-b70d-f80b7bd9a6f0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:06.683584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 70/140] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:06.690666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7f2e-fd92-48dc-a858-ad613c249b3a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:06.691101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7f2e-fd92-48dc-a858-ad613c249b3a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:06.691478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7f2e-fd92-48dc-a858-ad613c249b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:06.714856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-bdec7f2e-fd92-48dc-a858-ad613c249b3a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:06.717113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bdec7f2e-fd92-48dc-a858-ad613c249b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:06.855625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 71/141] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:06.922830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09cc34-1a63-4f88-b70d-f80b7bd9a6f0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:06.946973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:07.055359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09cc34-1a63-4f88-b70d-f80b7bd9a6f0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:07.096050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a738-9988-401a-9f68-7d0a38ff6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:07.096706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a738-9988-401a-9f68-7d0a38ff6843 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:07.097015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a738-9988-401a-9f68-7d0a38ff6843 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:07.097299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a738-9988-401a-9f68-7d0a38ff6843 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:07.114384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285a738-9988-401a-9f68-7d0a38ff6843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1285a738-9988-401a-9f68-7d0a38ff6843 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:07.119624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:07.120472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:07.121289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 71/142] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:07.128042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec7f2e-fd92-48dc-a858-ad613c249b3a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:07.212288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:07.255527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec7f2e-fd92-48dc-a858-ad613c249b3a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:07.296640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:07.297291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:07.297576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:07.297850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:07.298533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:07.298838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:07.300314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:07.310529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 72/143] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:07.318203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a738-9988-401a-9f68-7d0a38ff6843 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:07.453297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:07.509577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:07.569291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a738-9988-401a-9f68-7d0a38ff6843 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:07.658599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f885-7a24-4811-bc03-99e941c1edda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:07.659594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f885-7a24-4811-bc03-99e941c1edda None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:07.660112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f885-7a24-4811-bc03-99e941c1edda None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:07.660579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f885-7a24-4811-bc03-99e941c1edda None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:07.662582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f885-7a24-4811-bc03-99e941c1edda None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:07.664435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8f885-7a24-4811-bc03-99e941c1edda None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:07.669551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 72/144] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:07 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:07.673916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f885-7a24-4811-bc03-99e941c1edda None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:07.695516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e39bd6-3e52-4b24-b48d-ec7976a84e31 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:07.731874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:07.761692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83ad12-1a41-4536-b5e0-62266e1b0758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:07.763327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ad12-1a41-4536-b5e0-62266e1b0758 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:07.763876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ad12-1a41-4536-b5e0-62266e1b0758 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:07.764354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ad12-1a41-4536-b5e0-62266e1b0758 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:07.766603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83ad12-1a41-4536-b5e0-62266e1b0758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:07.769588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83ad12-1a41-4536-b5e0-62266e1b0758 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:07.772061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 73/145] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:07.779814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83ad12-1a41-4536-b5e0-62266e1b0758 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:07.932865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8f885-7a24-4811-bc03-99e941c1edda None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:07.960986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83ad12-1a41-4536-b5e0-62266e1b0758 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:08.031102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017872a-bf4e-4e1a-a3c1-777f6a27b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:08.031856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017872a-bf4e-4e1a-a3c1-777f6a27b1fc None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.032233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017872a-bf4e-4e1a-a3c1-777f6a27b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.032600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017872a-bf4e-4e1a-a3c1-777f6a27b1fc None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.033410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017872a-bf4e-4e1a-a3c1-777f6a27b1fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:08.034179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44daf4-0abc-4a83-91b4-1739e7fc218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:08.034976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44daf4-0abc-4a83-91b4-1739e7fc218e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.035130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017872a-bf4e-4e1a-a3c1-777f6a27b1fc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:08.035539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44daf4-0abc-4a83-91b4-1739e7fc218e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.035955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44daf4-0abc-4a83-91b4-1739e7fc218e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.065552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:08.122633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44daf4-0abc-4a83-91b4-1739e7fc218e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:08.124114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44daf4-0abc-4a83-91b4-1739e7fc218e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:08.163956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 74/146] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:07 2022] POST /identity/v3/users => generated 283 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:11:08.235094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 73/147] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:11:08.241004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017872a-bf4e-4e1a-a3c1-777f6a27b1fc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:08.347493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:08.492822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017872a-bf4e-4e1a-a3c1-777f6a27b1fc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:08.541876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab53ca-96c8-4040-a68e-9a27c9e039eb None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.542387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab53ca-96c8-4040-a68e-9a27c9e039eb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.542467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab53ca-96c8-4040-a68e-9a27c9e039eb None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.543787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 74/148] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:08.550492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ee77-4a2c-4195-8a8a-680d74000578 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.550787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ee77-4a2c-4195-8a8a-680d74000578 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.551059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521ee77-4a2c-4195-8a8a-680d74000578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.554788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb172c-1467-4f78-b487-595829cbb145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:08.555428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb172c-1467-4f78-b487-595829cbb145 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.555717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb172c-1467-4f78-b487-595829cbb145 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.555994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb172c-1467-4f78-b487-595829cbb145 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.561644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb172c-1467-4f78-b487-595829cbb145 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:08.563114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb172c-1467-4f78-b487-595829cbb145 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:08.564985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 75/149] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:08 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:08.572093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb172c-1467-4f78-b487-595829cbb145 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:08.586166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7521ee77-4a2c-4195-8a8a-680d74000578 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:08.587178 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7521ee77-4a2c-4195-8a8a-680d74000578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:08.656015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:08.686649 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb172c-1467-4f78-b487-595829cbb145 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:08.697044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 75/150] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:08.708068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:08.745758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2e8cc-95f2-491a-b24d-5ab0e1825be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:08.747401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8cc-95f2-491a-b24d-5ab0e1825be9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.747701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8cc-95f2-491a-b24d-5ab0e1825be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.747975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8cc-95f2-491a-b24d-5ab0e1825be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.748718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e8cc-95f2-491a-b24d-5ab0e1825be9 None admin] RBAC: Adding query filter params (role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=1a563089af444e2c9c4d6f29feb1630b, user.id=cf96e05ed7054e0e8c8392a93922e1d0) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:08.749047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e8cc-95f2-491a-b24d-5ab0e1825be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:08.750487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e8cc-95f2-491a-b24d-5ab0e1825be9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:08.756963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 76/151] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:08 2022] GET /identity/v3/role_assignments?user.id=cf96e05ed7054e0e8c8392a93922e1d0&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:08.946897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48e7a-6da3-43d1-9b58-32d6adcc410e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.947198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48e7a-6da3-43d1-9b58-32d6adcc410e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.947380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48e7a-6da3-43d1-9b58-32d6adcc410e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.948918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 76/152] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:08.954257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6ae0-e349-4095-ae38-7edbe8b871f5 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.954548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6ae0-e349-4095-ae38-7edbe8b871f5 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.954828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb6ae0-e349-4095-ae38-7edbe8b871f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.979495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-9fcb6ae0-e349-4095-ae38-7edbe8b871f5 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:08.980690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9fcb6ae0-e349-4095-ae38-7edbe8b871f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:09.071309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 77/153] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:09.178446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae48e7a-6da3-43d1-9b58-32d6adcc410e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:09.310722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae48e7a-6da3-43d1-9b58-32d6adcc410e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:09.346541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0785f-0e8f-42b3-9c49-a7d696f37d05 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.346849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0785f-0e8f-42b3-9c49-a7d696f37d05 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.347099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0785f-0e8f-42b3-9c49-a7d696f37d05 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.348690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 78/154] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:09.353885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b7783-1294-4c8a-9101-a70e038921d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:09.354536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b7783-1294-4c8a-9101-a70e038921d3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.354820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b7783-1294-4c8a-9101-a70e038921d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.355032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40331-2471-4e33-ab98-759cd645633c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.355134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b7783-1294-4c8a-9101-a70e038921d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.355518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40331-2471-4e33-ab98-759cd645633c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.355884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e40331-2471-4e33-ab98-759cd645633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.374601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b7783-1294-4c8a-9101-a70e038921d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ea1b7783-1294-4c8a-9101-a70e038921d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:09.379635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:09.380548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:09.381380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 77/155] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:09.388493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b7783-1294-4c8a-9101-a70e038921d3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:09.390530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-13e40331-2471-4e33-ab98-759cd645633c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:09.392584 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-13e40331-2471-4e33-ab98-759cd645633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:09.438882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:09.486671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 79/156] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:09.487575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e40331-2471-4e33-ab98-759cd645633c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:09.532534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b7783-1294-4c8a-9101-a70e038921d3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:09.553089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:09.584127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0d5db-abb4-4f1f-ac3f-240d8781776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:09.584763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0d5db-abb4-4f1f-ac3f-240d8781776a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.584972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0d5db-abb4-4f1f-ac3f-240d8781776a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.585267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0d5db-abb4-4f1f-ac3f-240d8781776a None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.586089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0d5db-abb4-4f1f-ac3f-240d8781776a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:09.586337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0d5db-abb4-4f1f-ac3f-240d8781776a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:09.587723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0d5db-abb4-4f1f-ac3f-240d8781776a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:09.597857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 78/157] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:09.598917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747264bc-24b0-48bd-bc80-c45ebb6e49bf None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.599207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747264bc-24b0-48bd-bc80-c45ebb6e49bf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.599537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747264bc-24b0-48bd-bc80-c45ebb6e49bf None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.604761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 79/158] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:09.606981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc9d8c-72f7-4f16-b9cf-dc284e536c77 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.607269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc9d8c-72f7-4f16-b9cf-dc284e536c77 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.607600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc9d8c-72f7-4f16-b9cf-dc284e536c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.642027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-08bc9d8c-72f7-4f16-b9cf-dc284e536c77 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:09.643594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-08bc9d8c-72f7-4f16-b9cf-dc284e536c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:09.655999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e40331-2471-4e33-ab98-759cd645633c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:09.692265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded19cbe-d585-46ec-bfeb-a9f46f3f1706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:09.693082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19cbe-d585-46ec-bfeb-a9f46f3f1706 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.693465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19cbe-d585-46ec-bfeb-a9f46f3f1706 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.694078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded19cbe-d585-46ec-bfeb-a9f46f3f1706 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.705541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded19cbe-d585-46ec-bfeb-a9f46f3f1706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ded19cbe-d585-46ec-bfeb-a9f46f3f1706 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:09.710583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:09.711683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:09.712579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:09.713322 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 80/159] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:09.713955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded19cbe-d585-46ec-bfeb-a9f46f3f1706 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:09.724987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 80/160] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:09.726221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc9d8c-72f7-4f16-b9cf-dc284e536c77 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:09.755395 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:09.839435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc9d8c-72f7-4f16-b9cf-dc284e536c77 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:09.848593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:09.859041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded19cbe-d585-46ec-bfeb-a9f46f3f1706 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:09.878335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:09.879210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.879643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.880065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.880880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:09.881409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:09.882931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:09.892864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 81/161] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:09.902741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:09.925898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d45eb0-8b66-4ee3-98c6-69cf403c3a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:09.926867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d45eb0-8b66-4ee3-98c6-69cf403c3a68 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:09.927336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d45eb0-8b66-4ee3-98c6-69cf403c3a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:09.927751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d45eb0-8b66-4ee3-98c6-69cf403c3a68 None admin] PATH_INFO: `/v3/users/3f61a5d555fa40c7b924347b5e300d2f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:09.930649 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d45eb0-8b66-4ee3-98c6-69cf403c3a68 None admin] RBAC: Authorizing `identity:get_user(user_id=3f61a5d555fa40c7b924347b5e300d2f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:09.932895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d45eb0-8b66-4ee3-98c6-69cf403c3a68 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:09.935395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 81/162] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:09 2022] GET /identity/v3/users/3f61a5d555fa40c7b924347b5e300d2f => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:09.941635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d45eb0-8b66-4ee3-98c6-69cf403c3a68 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:10.123148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:10.144631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a006581-c367-4654-9b7a-fc6048cf1252 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:10.177707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d45eb0-8b66-4ee3-98c6-69cf403c3a68 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:10.238812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201c362-9378-4309-99a2-6f90d54c8d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:10.239469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c362-9378-4309-99a2-6f90d54c8d8b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.239753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c362-9378-4309-99a2-6f90d54c8d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.240027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c362-9378-4309-99a2-6f90d54c8d8b None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.241702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201c362-9378-4309-99a2-6f90d54c8d8b None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:10.243226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201c362-9378-4309-99a2-6f90d54c8d8b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:10.244878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 82/163] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:09 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:10.245677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201c362-9378-4309-99a2-6f90d54c8d8b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:10.285685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85276dc-e57c-4efd-9c63-a7fdc21241aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:10.286349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85276dc-e57c-4efd-9c63-a7fdc21241aa None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.286636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85276dc-e57c-4efd-9c63-a7fdc21241aa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.286914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85276dc-e57c-4efd-9c63-a7fdc21241aa None admin] PATH_INFO: `/v3/users/de668eb3aa574c6fb312d4e0c57de17b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.287461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:10.289653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85276dc-e57c-4efd-9c63-a7fdc21241aa None admin] RBAC: Authorizing `identity:get_user(user_id=de668eb3aa574c6fb312d4e0c57de17b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:10.291115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85276dc-e57c-4efd-9c63-a7fdc21241aa None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:10.292720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 82/164] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:09 2022] GET /identity/v3/users/de668eb3aa574c6fb312d4e0c57de17b => generated 247 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:10.293530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85276dc-e57c-4efd-9c63-a7fdc21241aa None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:10.388175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201c362-9378-4309-99a2-6f90d54c8d8b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:10.428617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ebdb-df95-4895-98fd-cd445fbef74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:10.429774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ebdb-df95-4895-98fd-cd445fbef74e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.430279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ebdb-df95-4895-98fd-cd445fbef74e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.430748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ebdb-df95-4895-98fd-cd445fbef74e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.443968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ebdb-df95-4895-98fd-cd445fbef74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-a951ebdb-df95-4895-98fd-cd445fbef74e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:10.450191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:10.451136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:10.451914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:10.455081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 83/165] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:10.456212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ebdb-df95-4895-98fd-cd445fbef74e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:10.532218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85276dc-e57c-4efd-9c63-a7fdc21241aa None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:10.596814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac33d4-69ed-4a68-afc1-bf91edbfea9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:10.598329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac33d4-69ed-4a68-afc1-bf91edbfea9f None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.598817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac33d4-69ed-4a68-afc1-bf91edbfea9f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.599453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac33d4-69ed-4a68-afc1-bf91edbfea9f None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b/users/3f61a5d555fa40c7b924347b5e300d2f/roles/e9faf0d531a54b68be17731e1203edf3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.601715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac33d4-69ed-4a68-afc1-bf91edbfea9f None admin] RBAC: Authorizing `identity:create_grant(project_id=1a563089af444e2c9c4d6f29feb1630b, user_id=3f61a5d555fa40c7b924347b5e300d2f, role_id=e9faf0d531a54b68be17731e1203edf3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:10.603453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac33d4-69ed-4a68-afc1-bf91edbfea9f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:10.617342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:10.624721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ebdb-df95-4895-98fd-cd445fbef74e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:10.660431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621cc6c-a566-4b4d-b8a8-836b0a312889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:10.661011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621cc6c-a566-4b4d-b8a8-836b0a312889 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.661300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621cc6c-a566-4b4d-b8a8-836b0a312889 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.661575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621cc6c-a566-4b4d-b8a8-836b0a312889 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.672852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621cc6c-a566-4b4d-b8a8-836b0a312889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-b621cc6c-a566-4b4d-b8a8-836b0a312889 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:10.678273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:10.679162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:10.679948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:10.688971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 84/166] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:10.688971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621cc6c-a566-4b4d-b8a8-836b0a312889 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:10.698886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 83/167] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:10 2022] PUT /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b/users/3f61a5d555fa40c7b924347b5e300d2f/roles/e9faf0d531a54b68be17731e1203edf3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:10.705230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac33d4-69ed-4a68-afc1-bf91edbfea9f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:10.737881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:10.810617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621cc6c-a566-4b4d-b8a8-836b0a312889 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:10.849626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7dd78-56cd-4ea3-a536-0e201ace5bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:10.850251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7dd78-56cd-4ea3-a536-0e201ace5bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.850534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7dd78-56cd-4ea3-a536-0e201ace5bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.850813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7dd78-56cd-4ea3-a536-0e201ace5bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.902796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac33d4-69ed-4a68-afc1-bf91edbfea9f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:10.929841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:10.963616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:10.964602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.965286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.966427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.967818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:10.968386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:10.970154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:10.990457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 84/168] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:10.994937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:11.033232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7dd78-56cd-4ea3-a536-0e201ace5bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:11.035076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7dd78-56cd-4ea3-a536-0e201ace5bc9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:11.171519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:11.215404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771e402-320b-453f-8f67-49fc6a7cba57 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:11.273679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 85/169] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:11.274543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7dd78-56cd-4ea3-a536-0e201ace5bc9 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:11.306465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:11.307090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:11.307370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:11.307641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:11.308314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:11.308618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:11.310090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:11.329148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 85/170] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:11.330115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:11.421315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:11.508212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7dd78-56cd-4ea3-a536-0e201ace5bc9 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:11.550695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3f47a-c7b0-4703-8b5f-68898982b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:11.551716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f47a-c7b0-4703-8b5f-68898982b82d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:11.552196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f47a-c7b0-4703-8b5f-68898982b82d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:11.552681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f47a-c7b0-4703-8b5f-68898982b82d None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:11.554266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3f47a-c7b0-4703-8b5f-68898982b82d None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:11.555943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3f47a-c7b0-4703-8b5f-68898982b82d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:11.557975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 86/171] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:11 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:11.559065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3f47a-c7b0-4703-8b5f-68898982b82d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:11.643155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235838d5-22b5-499f-bbda-ff3e8e3bcf5d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:11.678517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3f47a-c7b0-4703-8b5f-68898982b82d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:11.718167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1989b27-d1d0-4a9e-9761-e1e8c4f44b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:11.719178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989b27-d1d0-4a9e-9761-e1e8c4f44b70 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:11.719669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989b27-d1d0-4a9e-9761-e1e8c4f44b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:11.720206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1989b27-d1d0-4a9e-9761-e1e8c4f44b70 None admin] PATH_INFO: `/v3/users/cf96e05ed7054e0e8c8392a93922e1d0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:11.721371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:11.729226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1989b27-d1d0-4a9e-9761-e1e8c4f44b70 None admin] RBAC: Authorizing `identity:get_user(user_id=cf96e05ed7054e0e8c8392a93922e1d0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:11.731891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1989b27-d1d0-4a9e-9761-e1e8c4f44b70 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:11.734039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 87/172] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:11 2022] GET /identity/v3/users/cf96e05ed7054e0e8c8392a93922e1d0 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:11.734990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1989b27-d1d0-4a9e-9761-e1e8c4f44b70 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:11.780513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b7477-8ae1-405a-a308-773bf84c9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:11.780513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b7477-8ae1-405a-a308-773bf84c9391 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:11.780513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b7477-8ae1-405a-a308-773bf84c9391 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:11.780513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b7477-8ae1-405a-a308-773bf84c9391 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:11.785667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b7477-8ae1-405a-a308-773bf84c9391 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:11.787160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b7477-8ae1-405a-a308-773bf84c9391 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:11.792971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 86/173] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:11 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:11.792971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b7477-8ae1-405a-a308-773bf84c9391 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:11.816076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:11.932869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1989b27-d1d0-4a9e-9761-e1e8c4f44b70 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:12.005638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c906598-e26e-4af3-8c33-9041371a180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:12.006536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c906598-e26e-4af3-8c33-9041371a180b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.006967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c906598-e26e-4af3-8c33-9041371a180b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.007403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c906598-e26e-4af3-8c33-9041371a180b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.024216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b7477-8ae1-405a-a308-773bf84c9391 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:12.062661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ae01b-de7a-4ef5-b0c6-c7eb8d855cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:12.063281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ae01b-de7a-4ef5-b0c6-c7eb8d855cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.063565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ae01b-de7a-4ef5-b0c6-c7eb8d855cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.063837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ae01b-de7a-4ef5-b0c6-c7eb8d855cc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.081201 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:12.095275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c906598-e26e-4af3-8c33-9041371a180b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:12.097142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c906598-e26e-4af3-8c33-9041371a180b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:12.140321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ae01b-de7a-4ef5-b0c6-c7eb8d855cc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:12.142489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ae01b-de7a-4ef5-b0c6-c7eb8d855cc7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:12.155936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:12.204205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 88/174] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:12.205247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c906598-e26e-4af3-8c33-9041371a180b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:12.264238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 87/175] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:12.265716 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11490-df30-4b70-a019-a82a6d027d86 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.266081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11490-df30-4b70-a019-a82a6d027d86 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.266409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11490-df30-4b70-a019-a82a6d027d86 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.269171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 88/176] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:12.269171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201882d-a421-4ca4-a5ae-7aec2ae73482 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.269475 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201882d-a421-4ca4-a5ae-7aec2ae73482 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.269748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201882d-a421-4ca4-a5ae-7aec2ae73482 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.271193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 89/177] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:12.272251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83941e-b720-4cc9-a9bc-5f56563e5112 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.272538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83941e-b720-4cc9-a9bc-5f56563e5112 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.272802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83941e-b720-4cc9-a9bc-5f56563e5112 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.274272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 90/178] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:12.275267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83941e-b720-4cc9-a9bc-5f56563e5112 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:12.316960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:12.331484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c906598-e26e-4af3-8c33-9041371a180b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:12.368338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:12.369024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.369306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.369630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.370360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=1a563089af444e2c9c4d6f29feb1630b, user.id=de668eb3aa574c6fb312d4e0c57de17b) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:12.370659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:12.372144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:12.378513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 89/179] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:12 2022] GET /identity/v3/role_assignments?user.id=de668eb3aa574c6fb312d4e0c57de17b&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=41491b52194f43e2902307fb86036726 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:12.379151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:12.400403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83941e-b720-4cc9-a9bc-5f56563e5112 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:12.418325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:12.448520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c4707-01ea-4f40-a727-795f83697f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:12.449554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4707-01ea-4f40-a727-795f83697f24 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.449985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4707-01ea-4f40-a727-795f83697f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.450367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c4707-01ea-4f40-a727-795f83697f24 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.451774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c4707-01ea-4f40-a727-795f83697f24 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:12.453412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c4707-01ea-4f40-a727-795f83697f24 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:12.455440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 91/180] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:12 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:12.456804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05541782-d750-496a-84b5-0a126caacc94 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.457230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05541782-d750-496a-84b5-0a126caacc94 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.457610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05541782-d750-496a-84b5-0a126caacc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.478993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-05541782-d750-496a-84b5-0a126caacc94 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:12.480420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-05541782-d750-496a-84b5-0a126caacc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:12.525217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3059757-6504-45b9-a1ea-0801942f4574 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:12.567360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:12.568190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f2fb-d195-493f-aba6-a8660804222e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.568480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f2fb-d195-493f-aba6-a8660804222e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.568756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744f2fb-d195-493f-aba6-a8660804222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.574117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1944a-73ec-4862-8b0c-b5a311274c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:12.575987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1944a-73ec-4862-8b0c-b5a311274c97 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.576433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1944a-73ec-4862-8b0c-b5a311274c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.576842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1944a-73ec-4862-8b0c-b5a311274c97 None admin] PATH_INFO: `/v3/projects/98be5dac45ed41fa81df5c849ed3714c` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.578370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1944a-73ec-4862-8b0c-b5a311274c97 None admin] RBAC: Authorizing `identity:get_project(project_id=98be5dac45ed41fa81df5c849ed3714c)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:12.580096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1944a-73ec-4862-8b0c-b5a311274c97 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:12.582632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 90/182] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:12 2022] GET /identity/v3/projects/98be5dac45ed41fa81df5c849ed3714c => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:12.583988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4f40-8ebb-407c-a98f-d8acfbb104c3 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.584434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4f40-8ebb-407c-a98f-d8acfbb104c3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.585085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b4f40-8ebb-407c-a98f-d8acfbb104c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.600540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2744f2fb-d195-493f-aba6-a8660804222e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:12.602492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2744f2fb-d195-493f-aba6-a8660804222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:12.607723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-994b4f40-8ebb-407c-a98f-d8acfbb104c3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:12.609231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-994b4f40-8ebb-407c-a98f-d8acfbb104c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:12.633591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:12.698860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 93/184] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:12.699499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 91/184] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:12.699723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744f2fb-d195-493f-aba6-a8660804222e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:12.700351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b4f40-8ebb-407c-a98f-d8acfbb104c3 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:12.769449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:12.887401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b4f40-8ebb-407c-a98f-d8acfbb104c3 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:12.904732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744f2fb-d195-493f-aba6-a8660804222e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:12.964106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:12.964730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.965042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.965319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.966584 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] RBAC: Adding query filter params (role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=98be5dac45ed41fa81df5c849ed3714c, user.id=cf96e05ed7054e0e8c8392a93922e1d0) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:12.966893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:12.968348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:12.981671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 92/185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:12 2022] GET /identity/v3/role_assignments?user.id=cf96e05ed7054e0e8c8392a93922e1d0&scope.project.id=98be5dac45ed41fa81df5c849ed3714c&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:12.982267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:12.982944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:12.983194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:12.983469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:12.984221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] RBAC: Adding query filter params (role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=1a563089af444e2c9c4d6f29feb1630b, user.id=cf96e05ed7054e0e8c8392a93922e1d0) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:12.984607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:12.986183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:13.001375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 94/186] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:12 2022] GET /identity/v3/role_assignments?user.id=cf96e05ed7054e0e8c8392a93922e1d0&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=d278ed91749c4adf9b130d08698e7933 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:13.038617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.056835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.062060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.213443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.218648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950cab1-e3c6-47a4-a54c-e42311b8f3ee None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.229422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d050bfe-ac46-49e5-998f-ddcffb4e9e85 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.274143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4a0e1-bb91-4f34-a643-ce89d1a2a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.275281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4a0e1-bb91-4f34-a643-ce89d1a2a417 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.275821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4a0e1-bb91-4f34-a643-ce89d1a2a417 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.276386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4a0e1-bb91-4f34-a643-ce89d1a2a417 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.279151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f75eca-6672-44ae-9c49-390e80316cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.279919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f75eca-6672-44ae-9c49-390e80316cba None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.280198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f75eca-6672-44ae-9c49-390e80316cba None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.280579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f75eca-6672-44ae-9c49-390e80316cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.294177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f75eca-6672-44ae-9c49-390e80316cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:13.295571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4a0e1-bb91-4f34-a643-ce89d1a2a417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-66f75eca-6672-44ae-9c49-390e80316cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:13.299694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:13.300581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:13.301525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 93/187] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5be4a0e1-bb91-4f34-a643-ce89d1a2a417 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:13.304009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:13.304868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:13.305704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:13.306742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f75eca-6672-44ae-9c49-390e80316cba None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.306841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 95/188] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:13.311584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4a0e1-bb91-4f34-a643-ce89d1a2a417 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.400517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.430974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4a0e1-bb91-4f34-a643-ce89d1a2a417 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.432455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f75eca-6672-44ae-9c49-390e80316cba None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.469150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.470113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.470113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.470357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.471147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:13.471522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:13.472241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800404-b2a8-48dc-8aa3-70f3166be3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.472875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800404-b2a8-48dc-8aa3-70f3166be3aa None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.473121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:13.473233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800404-b2a8-48dc-8aa3-70f3166be3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.473543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800404-b2a8-48dc-8aa3-70f3166be3aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.474616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800404-b2a8-48dc-8aa3-70f3166be3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:13.476061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800404-b2a8-48dc-8aa3-70f3166be3aa None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:13.482061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 94/189] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:13.482061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800404-b2a8-48dc-8aa3-70f3166be3aa None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.486550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 96/190] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:13.489650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.513655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.586982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800404-b2a8-48dc-8aa3-70f3166be3aa None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.596335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2941f7-6048-4aa7-ba83-9edeb6f433bd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.620695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.621343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.622152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.622457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.623159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:13.623466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:13.625551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:13.633264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 95/191] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:13.633943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.638676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0a8b8-7171-4b01-8bb7-8f0d7d74ad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.639005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.640460 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a8b8-7171-4b01-8bb7-8f0d7d74ad8d None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.640901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a8b8-7171-4b01-8bb7-8f0d7d74ad8d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.641215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a8b8-7171-4b01-8bb7-8f0d7d74ad8d None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.642056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0a8b8-7171-4b01-8bb7-8f0d7d74ad8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:13.644419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0a8b8-7171-4b01-8bb7-8f0d7d74ad8d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:13.737866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305067a8-9b77-4683-8431-98b742d0b65c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.770835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777f612-42bb-44b3-b053-4ddd1d4bc6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.771458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f612-42bb-44b3-b053-4ddd1d4bc6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.771745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f612-42bb-44b3-b053-4ddd1d4bc6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.772021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777f612-42bb-44b3-b053-4ddd1d4bc6c9 None admin] PATH_INFO: `/v3/users/9c34fb25d4494e1c8dfa8df551985880` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.785150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777f612-42bb-44b3-b053-4ddd1d4bc6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=9c34fb25d4494e1c8dfa8df551985880)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:13.786669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777f612-42bb-44b3-b053-4ddd1d4bc6c9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:13.788276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 96/192] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/users/9c34fb25d4494e1c8dfa8df551985880 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:13.793083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4b964-cb2c-46de-a99f-4b3a8fe4962b None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.793083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4b964-cb2c-46de-a99f-4b3a8fe4962b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.793083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4b964-cb2c-46de-a99f-4b3a8fe4962b None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.793083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 97/193] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:13.793083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4b964-cb2c-46de-a99f-4b3a8fe4962b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.802096 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 97/194] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:13 2022] POST /identity/v3/users => generated 297 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:13.802096 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0a8b8-7171-4b01-8bb7-8f0d7d74ad8d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.882045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.893220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.921273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0a8b8-7171-4b01-8bb7-8f0d7d74ad8d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.931842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4b964-cb2c-46de-a99f-4b3a8fe4962b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.961841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588dc4-8dd1-4376-974b-a5bc6c4c36d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.962750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588dc4-8dd1-4376-974b-a5bc6c4c36d2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.963038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588dc4-8dd1-4376-974b-a5bc6c4c36d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.963316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588dc4-8dd1-4376-974b-a5bc6c4c36d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.974548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e5453-666e-46e7-839d-81a082af56e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.975206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e5453-666e-46e7-839d-81a082af56e1 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.975493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e5453-666e-46e7-839d-81a082af56e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.975766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e5453-666e-46e7-839d-81a082af56e1 None admin] PATH_INFO: `/v3/users/9c34fb25d4494e1c8dfa8df551985880` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.976910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e5453-666e-46e7-839d-81a082af56e1 None admin] RBAC: Authorizing `identity:get_user(user_id=9c34fb25d4494e1c8dfa8df551985880)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:13.978383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e5453-666e-46e7-839d-81a082af56e1 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:13.979960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 98/195] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/users/9c34fb25d4494e1c8dfa8df551985880 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:13.987142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee2ac-1518-474e-bfac-e478112a08a7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.987418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee2ac-1518-474e-bfac-e478112a08a7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.987699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ee2ac-1518-474e-bfac-e478112a08a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:14.009301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-464ee2ac-1518-474e-bfac-e478112a08a7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:14.010432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-464ee2ac-1518-474e-bfac-e478112a08a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:14.048563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588dc4-8dd1-4376-974b-a5bc6c4c36d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:14.050451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05588dc4-8dd1-4376-974b-a5bc6c4c36d2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:14.104623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 99/196] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:14.105544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ee2ac-1518-474e-bfac-e478112a08a7 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:14.158850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:14.183102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:14.186645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 98/197] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:14.192205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588dc4-8dd1-4376-974b-a5bc6c4c36d2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:14.222680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ee2ac-1518-474e-bfac-e478112a08a7 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:14.266783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800a0d8-3208-4d3b-a816-010c91020970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:14.267568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800a0d8-3208-4d3b-a816-010c91020970 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:14.267849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800a0d8-3208-4d3b-a816-010c91020970 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:14.268121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800a0d8-3208-4d3b-a816-010c91020970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:14.345358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800a0d8-3208-4d3b-a816-010c91020970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:14.346849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800a0d8-3208-4d3b-a816-010c91020970 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:14.372792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05588dc4-8dd1-4376-974b-a5bc6c4c36d2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:14.409326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:14.453106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 100/198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:14.458663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800a0d8-3208-4d3b-a816-010c91020970 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:14.461237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25263a9b-fcf7-4025-b6e7-b9d69e6839bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:14.461885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25263a9b-fcf7-4025-b6e7-b9d69e6839bf None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:14.462160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25263a9b-fcf7-4025-b6e7-b9d69e6839bf None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:14.462430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25263a9b-fcf7-4025-b6e7-b9d69e6839bf None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:14.473735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25263a9b-fcf7-4025-b6e7-b9d69e6839bf None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:14.475576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25263a9b-fcf7-4025-b6e7-b9d69e6839bf None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:14.477551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 99/199] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:14 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:14.485958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25263a9b-fcf7-4025-b6e7-b9d69e6839bf None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:14.547972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:14.562975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800a0d8-3208-4d3b-a816-010c91020970 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:14.597943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720880d1-57f6-4fc0-9884-540864587c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:14.598605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720880d1-57f6-4fc0-9884-540864587c39 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:14.598842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720880d1-57f6-4fc0-9884-540864587c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:14.599113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720880d1-57f6-4fc0-9884-540864587c39 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:14.600257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720880d1-57f6-4fc0-9884-540864587c39 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:14.601844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720880d1-57f6-4fc0-9884-540864587c39 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:14.603607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 101/200] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:14 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:14.608221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720880d1-57f6-4fc0-9884-540864587c39 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:14.617532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25263a9b-fcf7-4025-b6e7-b9d69e6839bf None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:14.634372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:14.656623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:14.657638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:14.658170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:14.658640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:14.659668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=f1abcea21ac844edaa06b198155110b4, user.id=9c34fb25d4494e1c8dfa8df551985880) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:14.660197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:14.661891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:14.667809 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 100/201] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:14 2022] GET /identity/v3/role_assignments?user.id=9c34fb25d4494e1c8dfa8df551985880&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=41491b52194f43e2902307fb86036726 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:14.669069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:14.715841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720880d1-57f6-4fc0-9884-540864587c39 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:14.755407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aec04a-6f45-4d40-940e-26326c850f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:14.756080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aec04a-6f45-4d40-940e-26326c850f5e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:14.756359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aec04a-6f45-4d40-940e-26326c850f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:14.756631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aec04a-6f45-4d40-940e-26326c850f5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:14.769040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aec04a-6f45-4d40-940e-26326c850f5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-d6aec04a-6f45-4d40-940e-26326c850f5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:14.774433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:14.775748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:14.776541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 102/202] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:14.782819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aec04a-6f45-4d40-940e-26326c850f5e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:14.883489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbe6a1-74dd-4f1c-88f7-5c8c4c35116e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:14.910433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:14.937331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:14.955243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aec04a-6f45-4d40-940e-26326c850f5e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:14.957308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:14.957925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:14.958204 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:14.958471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:14.959213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] RBAC: Adding query filter params (role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=f1abcea21ac844edaa06b198155110b4, user.id=9c34fb25d4494e1c8dfa8df551985880) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:14.959517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:14.960982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:14.976082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 101/203] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:14 2022] GET /identity/v3/role_assignments?user.id=9c34fb25d4494e1c8dfa8df551985880&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=d278ed91749c4adf9b130d08698e7933 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:15.024693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:15.025608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:15.025882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:15.026154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:15.026831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:15.027131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:15.029186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:15.044581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 103/204] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:15.050493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:15.206987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc02289-a628-42fa-93ae-42e0fd3c7951 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:15.244515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199684e-df8e-4829-a32d-e286db53dbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:15.245186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199684e-df8e-4829-a32d-e286db53dbbe None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:15.245489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199684e-df8e-4829-a32d-e286db53dbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:15.245752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199684e-df8e-4829-a32d-e286db53dbbe None admin] PATH_INFO: `/v3/users/3f61a5d555fa40c7b924347b5e300d2f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:15.247497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199684e-df8e-4829-a32d-e286db53dbbe None admin] RBAC: Authorizing `identity:get_user(user_id=3f61a5d555fa40c7b924347b5e300d2f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:15.249436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199684e-df8e-4829-a32d-e286db53dbbe None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:15.251065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 102/205] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:15 2022] GET /identity/v3/users/3f61a5d555fa40c7b924347b5e300d2f => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:15.256777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:15.410682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98354031-e441-4cea-816e-a2ed66c9f5cc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:15.463537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047f166-a689-429e-869f-c97baa2c0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:15.464078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f166-a689-429e-869f-c97baa2c0799 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:15.464355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f166-a689-429e-869f-c97baa2c0799 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:15.464623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f166-a689-429e-869f-c97baa2c0799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:15.484602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:15.536759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047f166-a689-429e-869f-c97baa2c0799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:15.538262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047f166-a689-429e-869f-c97baa2c0799 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:15.675020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 104/206] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:15.680769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199684e-df8e-4829-a32d-e286db53dbbe None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:15.748860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:15.814005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199684e-df8e-4829-a32d-e286db53dbbe None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:15.877653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e8f2a-239f-47e2-bc4d-5ec29677e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:15.878308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e8f2a-239f-47e2-bc4d-5ec29677e718 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:15.878590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e8f2a-239f-47e2-bc4d-5ec29677e718 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:15.878864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e8f2a-239f-47e2-bc4d-5ec29677e718 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:15.880026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e8f2a-239f-47e2-bc4d-5ec29677e718 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:15.881514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e8f2a-239f-47e2-bc4d-5ec29677e718 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:15.883306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 103/207] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:15 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:15.889599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047f166-a689-429e-869f-c97baa2c0799 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:15.978029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:16.040919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047f166-a689-429e-869f-c97baa2c0799 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:16.091046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bdc9b-7e5a-4ac0-b4c9-f79e9d631194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:16.091661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdc9b-7e5a-4ac0-b4c9-f79e9d631194 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:16.091939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdc9b-7e5a-4ac0-b4c9-f79e9d631194 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:16.092209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bdc9b-7e5a-4ac0-b4c9-f79e9d631194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.092966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bdc9b-7e5a-4ac0-b4c9-f79e9d631194 None admin] RBAC: Adding query filter params (role.id=e9faf0d531a54b68be17731e1203edf3, scope.project.id=1a563089af444e2c9c4d6f29feb1630b, user.id=3f61a5d555fa40c7b924347b5e300d2f) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:16.093270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bdc9b-7e5a-4ac0-b4c9-f79e9d631194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:16.094730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bdc9b-7e5a-4ac0-b4c9-f79e9d631194 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:16.105895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 105/208] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:15 2022] GET /identity/v3/role_assignments?user.id=3f61a5d555fa40c7b924347b5e300d2f&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=e9faf0d531a54b68be17731e1203edf3 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:16.171225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d246-2bb8-4e4f-ab58-b7d557142ce6 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:16.172223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d246-2bb8-4e4f-ab58-b7d557142ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:16.172722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7d246-2bb8-4e4f-ab58-b7d557142ce6 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.174438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 104/209] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:16.180672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e6f00-db9a-4a45-ac72-4043d3babdf6 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:16.181024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e6f00-db9a-4a45-ac72-4043d3babdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:16.181253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e6f00-db9a-4a45-ac72-4043d3babdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.206904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ff0e6f00-db9a-4a45-ac72-4043d3babdf6 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:16.208443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ff0e6f00-db9a-4a45-ac72-4043d3babdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:16.305158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 106/210] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:16.498333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed80755-276b-435b-bee6-60d0f8d2d0fb None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:16.498998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed80755-276b-435b-bee6-60d0f8d2d0fb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:16.499500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed80755-276b-435b-bee6-60d0f8d2d0fb None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.501352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 105/211] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:16.506626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55039f42-9770-4412-b162-f4ad131e58cc None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:16.506920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55039f42-9770-4412-b162-f4ad131e58cc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:16.507194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55039f42-9770-4412-b162-f4ad131e58cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.529011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-55039f42-9770-4412-b162-f4ad131e58cc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:16.530192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-55039f42-9770-4412-b162-f4ad131e58cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:16.573923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:16.606077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 107/212] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:16.609340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed80755-276b-435b-bee6-60d0f8d2d0fb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:16.721195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed80755-276b-435b-bee6-60d0f8d2d0fb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:16.735745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:16.761108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50a3e2-7d96-475f-8000-9f2781154c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:16.762074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50a3e2-7d96-475f-8000-9f2781154c14 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:16.763186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50a3e2-7d96-475f-8000-9f2781154c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:16.763663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50a3e2-7d96-475f-8000-9f2781154c14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.775611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50a3e2-7d96-475f-8000-9f2781154c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-3f50a3e2-7d96-475f-8000-9f2781154c14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:16.781263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:16.782149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:16.782945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:16.785242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 106/213] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:16.793571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55039f42-9770-4412-b162-f4ad131e58cc None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:16.903731 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55039f42-9770-4412-b162-f4ad131e58cc None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:16.908629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50a3e2-7d96-475f-8000-9f2781154c14 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:16.952096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:16.953594 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:16.953907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:16.954190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.954873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:16.955179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:16.956560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:16.972718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 108/214] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:16.973828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:17.017033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:17.040007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50a3e2-7d96-475f-8000-9f2781154c14 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:17.083823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac046503-9f85-48c4-bdee-38511f00a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:17.084744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac046503-9f85-48c4-bdee-38511f00a073 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.085328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac046503-9f85-48c4-bdee-38511f00a073 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.085610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac046503-9f85-48c4-bdee-38511f00a073 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.086900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac046503-9f85-48c4-bdee-38511f00a073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:17.088382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac046503-9f85-48c4-bdee-38511f00a073 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:17.088612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5920b-d5b0-47a8-8107-b929009addc3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:17.094866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 107/215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:17.094866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1ff22-ce80-4a21-8123-05daebf2c99b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.094866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1ff22-ce80-4a21-8123-05daebf2c99b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.094866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1ff22-ce80-4a21-8123-05daebf2c99b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.094866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 108/216] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:17.097787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1ff22-ce80-4a21-8123-05daebf2c99b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:17.128693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76c9b-b5c8-4142-ba4a-29efc8f235b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:17.129489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76c9b-b5c8-4142-ba4a-29efc8f235b4 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.129769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76c9b-b5c8-4142-ba4a-29efc8f235b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.130045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76c9b-b5c8-4142-ba4a-29efc8f235b4 None admin] PATH_INFO: `/v3/users/7708cdd341a141c48ed055661bfe2bdb` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.141176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:17.146787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c76c9b-b5c8-4142-ba4a-29efc8f235b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7708cdd341a141c48ed055661bfe2bdb)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:17.148277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c76c9b-b5c8-4142-ba4a-29efc8f235b4 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:17.150324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 109/217] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:16 2022] GET /identity/v3/users/7708cdd341a141c48ed055661bfe2bdb => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:17.151422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0e81-f7f3-4a1a-be67-27f9dc4d2234 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.151705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0e81-f7f3-4a1a-be67-27f9dc4d2234 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.151980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0e81-f7f3-4a1a-be67-27f9dc4d2234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.171678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-47dd0e81-f7f3-4a1a-be67-27f9dc4d2234 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:17.172889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-47dd0e81-f7f3-4a1a-be67-27f9dc4d2234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:17.209332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1ff22-ce80-4a21-8123-05daebf2c99b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:17.240065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 110/218] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:17.240907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0e81-f7f3-4a1a-be67-27f9dc4d2234 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:17.245493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88580b-93a0-4be8-8d6a-a6edeb9ebc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:17.246125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88580b-93a0-4be8-8d6a-a6edeb9ebc9b None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.246528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88580b-93a0-4be8-8d6a-a6edeb9ebc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.247390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88580b-93a0-4be8-8d6a-a6edeb9ebc9b None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.248074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88580b-93a0-4be8-8d6a-a6edeb9ebc9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:17.250002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88580b-93a0-4be8-8d6a-a6edeb9ebc9b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:17.265872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:17.339207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0e81-f7f3-4a1a-be67-27f9dc4d2234 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:17.369117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 109/219] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:17 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:17.377199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9048b-9abd-405b-b3d3-6c68ec8b9492 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.377199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9048b-9abd-405b-b3d3-6c68ec8b9492 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.377199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9048b-9abd-405b-b3d3-6c68ec8b9492 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.377199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 110/220] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:17.378577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9fb12-e1ca-4104-b435-c8dbd409af02 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.378804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9fb12-e1ca-4104-b435-c8dbd409af02 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.379080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9fb12-e1ca-4104-b435-c8dbd409af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.383064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe927ab-880b-43a6-9ef3-b1e977adaa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:17.383850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe927ab-880b-43a6-9ef3-b1e977adaa9a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.384062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe927ab-880b-43a6-9ef3-b1e977adaa9a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.384334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe927ab-880b-43a6-9ef3-b1e977adaa9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.398994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b9a9fb12-e1ca-4104-b435-c8dbd409af02 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:17.400495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b9a9fb12-e1ca-4104-b435-c8dbd409af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:17.469567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe927ab-880b-43a6-9ef3-b1e977adaa9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:17.471100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe927ab-880b-43a6-9ef3-b1e977adaa9a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:17.496247 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 111/221] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:17.506071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:17.514415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9fb12-e1ca-4104-b435-c8dbd409af02 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:17.546522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:17.584022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 111/222] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:17.591443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe927ab-880b-43a6-9ef3-b1e977adaa9a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:17.650458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9fb12-e1ca-4104-b435-c8dbd409af02 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:17.715647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fdf08-7786-4125-9e87-4c7809e047ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:17.716299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fdf08-7786-4125-9e87-4c7809e047ed None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.716573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fdf08-7786-4125-9e87-4c7809e047ed None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.716842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fdf08-7786-4125-9e87-4c7809e047ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.731946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe927ab-880b-43a6-9ef3-b1e977adaa9a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:17.734250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fdf08-7786-4125-9e87-4c7809e047ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-bd8fdf08-7786-4125-9e87-4c7809e047ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:17.739335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:17.740227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:17.741170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 112/223] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:17.753998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fdf08-7786-4125-9e87-4c7809e047ed None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:17.762542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:17.779087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28555ee-1104-496d-b881-3d6fd764b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:17.779850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28555ee-1104-496d-b881-3d6fd764b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.780133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28555ee-1104-496d-b881-3d6fd764b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.780489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28555ee-1104-496d-b881-3d6fd764b9f1 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.781768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28555ee-1104-496d-b881-3d6fd764b9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:17.783234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28555ee-1104-496d-b881-3d6fd764b9f1 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:17.786846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 112/224] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:17 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:17.790967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28555ee-1104-496d-b881-3d6fd764b9f1 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:17.881359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:17.897649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fdf08-7786-4125-9e87-4c7809e047ed None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:17.926214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28555ee-1104-496d-b881-3d6fd764b9f1 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:17.942583 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:17.943642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.943934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.944215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.945171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:17.945487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:17.947324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:17.960162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 113/225] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:17.961376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:17.964797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:17.966231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:17.966609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:17.967032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:17.967860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] RBAC: Adding query filter params (role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=f1abcea21ac844edaa06b198155110b4, user.id=7708cdd341a141c48ed055661bfe2bdb) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:17.968262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:17.969842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:17.975915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 113/226] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:17 2022] GET /identity/v3/role_assignments?user.id=7708cdd341a141c48ed055661bfe2bdb&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:17.981835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:18.083636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81796f-339d-44f8-95ab-25bbea4df621 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:18.129987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:18.147381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9406c32-ec8f-4bf2-981b-c96e46490f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:18.147381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9406c32-ec8f-4bf2-981b-c96e46490f87 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.147381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9406c32-ec8f-4bf2-981b-c96e46490f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.147381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9406c32-ec8f-4bf2-981b-c96e46490f87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.157918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9406c32-ec8f-4bf2-981b-c96e46490f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d9406c32-ec8f-4bf2-981b-c96e46490f87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:18.164106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:18.165286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:18.166270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:18.168823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 114/227] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:18.175576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9406c32-ec8f-4bf2-981b-c96e46490f87 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:18.187996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:18.204198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a3f6-213e-4c13-b3ca-81990de088e8 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:18.243025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d003071-d696-4ece-8c7d-62728451cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:18.244331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d003071-d696-4ece-8c7d-62728451cc44 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.244779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d003071-d696-4ece-8c7d-62728451cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.245229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d003071-d696-4ece-8c7d-62728451cc44 None admin] PATH_INFO: `/v3/users/9c34fb25d4494e1c8dfa8df551985880` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.247099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d003071-d696-4ece-8c7d-62728451cc44 None admin] RBAC: Authorizing `identity:get_user(user_id=9c34fb25d4494e1c8dfa8df551985880)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:18.249684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d003071-d696-4ece-8c7d-62728451cc44 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:18.252355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 114/228] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:17 2022] GET /identity/v3/users/9c34fb25d4494e1c8dfa8df551985880 => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:18.260042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d003071-d696-4ece-8c7d-62728451cc44 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:18.313997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9406c32-ec8f-4bf2-981b-c96e46490f87 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:18.386616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:18.387571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.388000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.388445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.389295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:18.389745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:18.391764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:18.405670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 115/229] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:18.414042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:18.440728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d003071-d696-4ece-8c7d-62728451cc44 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:18.488078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:18.497975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:18.525333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1ef62-2b8c-4fc0-bf90-1998a5cdca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:18.525917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5d70c-c3de-42f0-9ca6-b8edf1b94869 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:18.526072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ef62-2b8c-4fc0-bf90-1998a5cdca4d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.526261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ef62-2b8c-4fc0-bf90-1998a5cdca4d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.526508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ef62-2b8c-4fc0-bf90-1998a5cdca4d None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.527683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1ef62-2b8c-4fc0-bf90-1998a5cdca4d None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:18.530427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1ef62-2b8c-4fc0-bf90-1998a5cdca4d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:18.531652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 115/230] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:18 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:18.538051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1ef62-2b8c-4fc0-bf90-1998a5cdca4d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:18.569151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d334d2-1c52-4677-bfed-d8a3196928da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:18.570843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d334d2-1c52-4677-bfed-d8a3196928da None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.571548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d334d2-1c52-4677-bfed-d8a3196928da None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.572686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d334d2-1c52-4677-bfed-d8a3196928da None admin] PATH_INFO: `/v3/users/9c34fb25d4494e1c8dfa8df551985880` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.575186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d334d2-1c52-4677-bfed-d8a3196928da None admin] RBAC: Authorizing `identity:get_user(user_id=9c34fb25d4494e1c8dfa8df551985880)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:18.577725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d334d2-1c52-4677-bfed-d8a3196928da None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:18.581958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 116/231] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:18 2022] GET /identity/v3/users/9c34fb25d4494e1c8dfa8df551985880 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:18.589981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d334d2-1c52-4677-bfed-d8a3196928da None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:18.702027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d334d2-1c52-4677-bfed-d8a3196928da None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:18.736675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1ef62-2b8c-4fc0-bf90-1998a5cdca4d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:18.740666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c855d0-0078-44a9-8454-9d78ba3851b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:18.741569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c855d0-0078-44a9-8454-9d78ba3851b2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.742112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c855d0-0078-44a9-8454-9d78ba3851b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.742565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c855d0-0078-44a9-8454-9d78ba3851b2 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.743997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c855d0-0078-44a9-8454-9d78ba3851b2 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:18.746156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c855d0-0078-44a9-8454-9d78ba3851b2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:18.748778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 117/232] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:18 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:18.754314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c855d0-0078-44a9-8454-9d78ba3851b2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:18.760688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:18.806316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c5820-f966-4de5-9f29-d97ca4a0c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:18.807007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c5820-f966-4de5-9f29-d97ca4a0c702 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.807295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c5820-f966-4de5-9f29-d97ca4a0c702 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.807574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c5820-f966-4de5-9f29-d97ca4a0c702 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4/users/9c34fb25d4494e1c8dfa8df551985880/roles/d278ed91749c4adf9b130d08698e7933` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.813747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c5820-f966-4de5-9f29-d97ca4a0c702 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1abcea21ac844edaa06b198155110b4, user_id=9c34fb25d4494e1c8dfa8df551985880, role_id=d278ed91749c4adf9b130d08698e7933)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:18.815232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c5820-f966-4de5-9f29-d97ca4a0c702 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:18.875143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c855d0-0078-44a9-8454-9d78ba3851b2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:18.914862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4a599-9249-4887-bf7e-c12def962481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:18.915927 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a599-9249-4887-bf7e-c12def962481 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.916385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a599-9249-4887-bf7e-c12def962481 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.916881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4a599-9249-4887-bf7e-c12def962481 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4/users/9c34fb25d4494e1c8dfa8df551985880/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.919660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4a599-9249-4887-bf7e-c12def962481 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1abcea21ac844edaa06b198155110b4, user_id=9c34fb25d4494e1c8dfa8df551985880, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:18.921511 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4a599-9249-4887-bf7e-c12def962481 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:18.927897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 116/233] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:18 2022] PUT /identity/v3/projects/f1abcea21ac844edaa06b198155110b4/users/9c34fb25d4494e1c8dfa8df551985880/roles/d278ed91749c4adf9b130d08698e7933 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:18.999257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 118/234] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:18 2022] PUT /identity/v3/projects/f1abcea21ac844edaa06b198155110b4/users/9c34fb25d4494e1c8dfa8df551985880/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:11:19.921902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401a9e3-d982-46d7-a3a8-36dd41a40142 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:19.922270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401a9e3-d982-46d7-a3a8-36dd41a40142 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:19.922471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401a9e3-d982-46d7-a3a8-36dd41a40142 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:19.924031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 117/235] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:19.929549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31de08c-964a-4aa2-9f8c-dfcc1a4927f9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:19.930416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31de08c-964a-4aa2-9f8c-dfcc1a4927f9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:19.930930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31de08c-964a-4aa2-9f8c-dfcc1a4927f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:19.952577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a14e-6e8b-4490-bb9a-f0984bb23354 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:19.952577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a14e-6e8b-4490-bb9a-f0984bb23354 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:19.952577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a14e-6e8b-4490-bb9a-f0984bb23354 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:19.952577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 118/236] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:11:19.957126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a31de08c-964a-4aa2-9f8c-dfcc1a4927f9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:19.957756 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f181-2d8b-438d-8bc8-e1283f63d376 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:19.958052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f181-2d8b-438d-8bc8-e1283f63d376 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:19.958333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589f181-2d8b-438d-8bc8-e1283f63d376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:19.959200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a31de08c-964a-4aa2-9f8c-dfcc1a4927f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:19.994162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8589f181-2d8b-438d-8bc8-e1283f63d376 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:19.995374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8589f181-2d8b-438d-8bc8-e1283f63d376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:20.067485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:20.089167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:20.098919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 119/237] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:20.100642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 119/238] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:20.241877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5a6f-3df6-416b-ab46-3ae6f224520b None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:20.242531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5a6f-3df6-416b-ab46-3ae6f224520b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:20.243016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd5a6f-3df6-416b-ab46-3ae6f224520b None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:20.245044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 120/239] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:20.250198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d056ab-92d1-490f-9cbd-4b6f6520c673 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:20.250768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d056ab-92d1-490f-9cbd-4b6f6520c673 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:20.251256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d056ab-92d1-490f-9cbd-4b6f6520c673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:20.275818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f2d056ab-92d1-490f-9cbd-4b6f6520c673 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:20.277360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f2d056ab-92d1-490f-9cbd-4b6f6520c673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:20.348336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 120/240] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:20.444856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5a6f-3df6-416b-ab46-3ae6f224520b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:20.512675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d056ab-92d1-490f-9cbd-4b6f6520c673 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:20.598635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd5a6f-3df6-416b-ab46-3ae6f224520b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:20.667918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d056ab-92d1-490f-9cbd-4b6f6520c673 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:20.677664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e60833-093f-4994-aaf4-e6a7cc6d86d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:20.678315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e60833-093f-4994-aaf4-e6a7cc6d86d3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:20.678598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e60833-093f-4994-aaf4-e6a7cc6d86d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:20.678870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e60833-093f-4994-aaf4-e6a7cc6d86d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:20.680102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e60833-093f-4994-aaf4-e6a7cc6d86d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:20.681605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e60833-093f-4994-aaf4-e6a7cc6d86d3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:20.683495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 121/241] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:20.689355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e60833-093f-4994-aaf4-e6a7cc6d86d3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:20.693220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:20.710771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa5af-069d-40bd-816d-cdfd8990ef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:20.711416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa5af-069d-40bd-816d-cdfd8990ef36 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:20.711694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa5af-069d-40bd-816d-cdfd8990ef36 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:20.711961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44aa5af-069d-40bd-816d-cdfd8990ef36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:20.732996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44aa5af-069d-40bd-816d-cdfd8990ef36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-e44aa5af-069d-40bd-816d-cdfd8990ef36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:20.738970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:20.739848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:20.740643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 121/242] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:20.741344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa5af-069d-40bd-816d-cdfd8990ef36 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:20.773357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:20.828099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e60833-093f-4994-aaf4-e6a7cc6d86d3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:20.845094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44aa5af-069d-40bd-816d-cdfd8990ef36 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:20.876720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa2f6c-cb65-4ca0-88e5-7af24f8a3539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:20.877899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa2f6c-cb65-4ca0-88e5-7af24f8a3539 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:20.878477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa2f6c-cb65-4ca0-88e5-7af24f8a3539 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:20.878944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa2f6c-cb65-4ca0-88e5-7af24f8a3539 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:20.879948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa2f6c-cb65-4ca0-88e5-7af24f8a3539 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:20.880188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c691-9a9b-40cd-8d99-385d919eb520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:20.880819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c691-9a9b-40cd-8d99-385d919eb520 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:20.881141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c691-9a9b-40cd-8d99-385d919eb520 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:20.881408 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575c691-9a9b-40cd-8d99-385d919eb520 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:20.882713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa2f6c-cb65-4ca0-88e5-7af24f8a3539 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:20.892430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1575c691-9a9b-40cd-8d99-385d919eb520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1575c691-9a9b-40cd-8d99-385d919eb520 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:20.897351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:20.898255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:20.899050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 122/243] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:20.899706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c691-9a9b-40cd-8d99-385d919eb520 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:20.951746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:20.960371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 122/244] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:20 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:20.967319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa2f6c-cb65-4ca0-88e5-7af24f8a3539 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:21.072305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1575c691-9a9b-40cd-8d99-385d919eb520 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:21.139010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:21.139552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.139827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.140095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.140768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:21.141095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:21.142483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:21.155651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 123/245] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:21.166205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:21.182082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa2f6c-cb65-4ca0-88e5-7af24f8a3539 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:21.193406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:21.231841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:21.232472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.232755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.234325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.235025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:21.235337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:21.236785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:21.248174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 123/246] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:21.253672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:21.304360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406792ad-737a-4ff6-bee0-c99b3d4a5efc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:21.314597 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:21.349965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e380d-ecbb-4bc7-a84c-74f36569a26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:21.350610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e380d-ecbb-4bc7-a84c-74f36569a26d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.350889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e380d-ecbb-4bc7-a84c-74f36569a26d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.351167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e380d-ecbb-4bc7-a84c-74f36569a26d None admin] PATH_INFO: `/v3/users/e3c6789cf495432597406196de06f173` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.373151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e380d-ecbb-4bc7-a84c-74f36569a26d None admin] RBAC: Authorizing `identity:get_user(user_id=e3c6789cf495432597406196de06f173)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:21.374630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e380d-ecbb-4bc7-a84c-74f36569a26d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:21.380812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 124/247] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:21 2022] GET /identity/v3/users/e3c6789cf495432597406196de06f173 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:21.380812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5834-bbf9-45c8-8fdb-342828b66a89 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.380812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5834-bbf9-45c8-8fdb-342828b66a89 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.380812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5834-bbf9-45c8-8fdb-342828b66a89 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.380812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 125/248] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:21.385160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36296d-047b-4023-8713-7edd7e3d27e7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.385445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36296d-047b-4023-8713-7edd7e3d27e7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.385722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36296d-047b-4023-8713-7edd7e3d27e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.386041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68e55f-7bc8-462f-94f1-8c6efae66f97 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:21.406482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3d36296d-047b-4023-8713-7edd7e3d27e7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:21.408459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3d36296d-047b-4023-8713-7edd7e3d27e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:21.438405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889ac96-5265-45e4-bdd6-32d51a5a1bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:21.439568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889ac96-5265-45e4-bdd6-32d51a5a1bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.439972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889ac96-5265-45e4-bdd6-32d51a5a1bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.440246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889ac96-5265-45e4-bdd6-32d51a5a1bc6 None admin] PATH_INFO: `/v3/users/7708cdd341a141c48ed055661bfe2bdb` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.442943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889ac96-5265-45e4-bdd6-32d51a5a1bc6 None admin] RBAC: Authorizing `identity:get_user(user_id=7708cdd341a141c48ed055661bfe2bdb)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:21.444668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889ac96-5265-45e4-bdd6-32d51a5a1bc6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:21.447095 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 124/249] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:21 2022] GET /identity/v3/users/7708cdd341a141c48ed055661bfe2bdb => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:21.448143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889ac96-5265-45e4-bdd6-32d51a5a1bc6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:21.492496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:21.498314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 126/250] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:21.502811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36296d-047b-4023-8713-7edd7e3d27e7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:21.570328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889ac96-5265-45e4-bdd6-32d51a5a1bc6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:21.611007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f608382-f298-40ed-aa3c-8bc7fa48e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:21.611634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f608382-f298-40ed-aa3c-8bc7fa48e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.611915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f608382-f298-40ed-aa3c-8bc7fa48e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.612189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f608382-f298-40ed-aa3c-8bc7fa48e6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.641989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36296d-047b-4023-8713-7edd7e3d27e7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:21.665392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:21.701247 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c632d-2de3-4bbf-9df2-2598e5b37124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:21.701888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c632d-2de3-4bbf-9df2-2598e5b37124 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.702165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c632d-2de3-4bbf-9df2-2598e5b37124 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.702433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c632d-2de3-4bbf-9df2-2598e5b37124 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.705482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c632d-2de3-4bbf-9df2-2598e5b37124 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:21.709382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c632d-2de3-4bbf-9df2-2598e5b37124 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:21.711039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 127/251] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:21 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:21.712167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36365e5-1de1-4907-b395-ef8c5e2267ec None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.712444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36365e5-1de1-4907-b395-ef8c5e2267ec None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.712714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36365e5-1de1-4907-b395-ef8c5e2267ec None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.713980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 128/252] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:21.717138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36365e5-1de1-4907-b395-ef8c5e2267ec None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:21.729766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f608382-f298-40ed-aa3c-8bc7fa48e6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:21.731989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f608382-f298-40ed-aa3c-8bc7fa48e6c0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:21.806095 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:21.892853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36365e5-1de1-4907-b395-ef8c5e2267ec None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:21.903655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 125/253] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:21.905336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286dce8-a4bd-4aed-8fce-9e2d57cc7e61 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.905835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286dce8-a4bd-4aed-8fce-9e2d57cc7e61 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.906253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286dce8-a4bd-4aed-8fce-9e2d57cc7e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.926333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-d286dce8-a4bd-4aed-8fce-9e2d57cc7e61 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:21.927754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d286dce8-a4bd-4aed-8fce-9e2d57cc7e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:21.931983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bbc6a-f3ac-4d66-a5bf-65bdbe809c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:21.931983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bbc6a-f3ac-4d66-a5bf-65bdbe809c68 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:21.932216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bbc6a-f3ac-4d66-a5bf-65bdbe809c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:21.932484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bbc6a-f3ac-4d66-a5bf-65bdbe809c68 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4/users/7708cdd341a141c48ed055661bfe2bdb/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:21.934473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bbc6a-f3ac-4d66-a5bf-65bdbe809c68 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1abcea21ac844edaa06b198155110b4, user_id=7708cdd341a141c48ed055661bfe2bdb, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:21.935941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bbc6a-f3ac-4d66-a5bf-65bdbe809c68 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:22.000691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 129/254] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:21 2022] PUT /identity/v3/projects/f1abcea21ac844edaa06b198155110b4/users/7708cdd341a141c48ed055661bfe2bdb/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:11:22.005830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bbc6a-f3ac-4d66-a5bf-65bdbe809c68 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:22.017743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 126/255] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:22.023633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286dce8-a4bd-4aed-8fce-9e2d57cc7e61 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:22.066692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:22.187739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bbc6a-f3ac-4d66-a5bf-65bdbe809c68 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:22.241613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be345c2-3da0-437d-b9a6-21a952d32310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:22.242525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be345c2-3da0-437d-b9a6-21a952d32310 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:22.243852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be345c2-3da0-437d-b9a6-21a952d32310 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:22.244298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be345c2-3da0-437d-b9a6-21a952d32310 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:22.265899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be345c2-3da0-437d-b9a6-21a952d32310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4be345c2-3da0-437d-b9a6-21a952d32310 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:22.275264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:22.276234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:22.277062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:22.279616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 130/256] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:22.287907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:22.288662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be345c2-3da0-437d-b9a6-21a952d32310 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:22.364053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286dce8-a4bd-4aed-8fce-9e2d57cc7e61 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:22.437397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed2d62-e5a8-4008-8ff5-ba6d680cc722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:22.438397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed2d62-e5a8-4008-8ff5-ba6d680cc722 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:22.438824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed2d62-e5a8-4008-8ff5-ba6d680cc722 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:22.439258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed2d62-e5a8-4008-8ff5-ba6d680cc722 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:22.440529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed2d62-e5a8-4008-8ff5-ba6d680cc722 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:22.445726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed2d62-e5a8-4008-8ff5-ba6d680cc722 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:22.450079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 127/257] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:22 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:22.453798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed2d62-e5a8-4008-8ff5-ba6d680cc722 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:22.457277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:22.493192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be345c2-3da0-437d-b9a6-21a952d32310 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:22.540978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:22.540978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:22.540978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:22.540978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:22.541530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:22.544967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:22.544967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:22.560974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 131/258] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:22.572972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:22.703927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed2d62-e5a8-4008-8ff5-ba6d680cc722 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:22.773799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b241-f85d-45e1-b7bb-a1cad1fb78d5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:22.790871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:22.791833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:22.792331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:22.792910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:22.794583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] RBAC: Adding query filter params (role.id=e9faf0d531a54b68be17731e1203edf3, scope.project.id=f1abcea21ac844edaa06b198155110b4, user.id=e3c6789cf495432597406196de06f173) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:22.795100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:22.796730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:22.805036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:22.820976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 128/259] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:22 2022] GET /identity/v3/role_assignments?user.id=e3c6789cf495432597406196de06f173&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=e9faf0d531a54b68be17731e1203edf3 => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:22.822422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:22.828985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fdaa6-8933-4be6-acd1-8622aaa804af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:22.828985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fdaa6-8933-4be6-acd1-8622aaa804af None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:22.828985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fdaa6-8933-4be6-acd1-8622aaa804af None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:22.829344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fdaa6-8933-4be6-acd1-8622aaa804af None admin] PATH_INFO: `/v3/users/9c34fb25d4494e1c8dfa8df551985880` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:22.836874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fdaa6-8933-4be6-acd1-8622aaa804af None admin] RBAC: Authorizing `identity:get_user(user_id=9c34fb25d4494e1c8dfa8df551985880)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:22.836874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fdaa6-8933-4be6-acd1-8622aaa804af None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:22.847004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 132/260] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:22 2022] GET /identity/v3/users/9c34fb25d4494e1c8dfa8df551985880 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:22.860978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fdaa6-8933-4be6-acd1-8622aaa804af None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:22.910182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:23.144344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e90ddf-2b00-4ece-bef7-bf4a7cb9b1f0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:23.173541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fdaa6-8933-4be6-acd1-8622aaa804af None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:23.196372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c2e61-4e6a-488e-bb77-198faaf99dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:23.197041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2e61-4e6a-488e-bb77-198faaf99dff None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:23.197323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2e61-4e6a-488e-bb77-198faaf99dff None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:23.197591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2e61-4e6a-488e-bb77-198faaf99dff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:23.221603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c2e61-4e6a-488e-bb77-198faaf99dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-984c2e61-4e6a-488e-bb77-198faaf99dff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:23.227348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:23.228235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:23.229065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 129/261] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:11:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:23.238973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c2e61-4e6a-488e-bb77-198faaf99dff None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:23.249827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd48f-853e-4c83-a82b-604297d96a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:23.250449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd48f-853e-4c83-a82b-604297d96a12 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:23.250728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd48f-853e-4c83-a82b-604297d96a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:23.250997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dd48f-853e-4c83-a82b-604297d96a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:23.378438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:23.450117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dd48f-853e-4c83-a82b-604297d96a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:23.451544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dd48f-853e-4c83-a82b-604297d96a12 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:23.453231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c2e61-4e6a-488e-bb77-198faaf99dff None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:23.485307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:23.517327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:23.518396 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:23.518874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:23.519365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:23.520230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:23.520727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:23.522318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:23.539423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 130/262] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:23.548786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:23.671007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 133/263] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 815 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:23.677122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd48f-853e-4c83-a82b-604297d96a12 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:23.818833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dd48f-853e-4c83-a82b-604297d96a12 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:23.833298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:23.854872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff0eb1-d364-4816-a97b-8b5c5c5d4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:23.857332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff0eb1-d364-4816-a97b-8b5c5c5d4736 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:23.857332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff0eb1-d364-4816-a97b-8b5c5c5d4736 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:23.857332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff0eb1-d364-4816-a97b-8b5c5c5d4736 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:23.858036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff0eb1-d364-4816-a97b-8b5c5c5d4736 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:23.859500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff0eb1-d364-4816-a97b-8b5c5c5d4736 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:23.861614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 134/264] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:23 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:23.864661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106bc7-5700-4f87-bb1b-5eff57070233 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:23.864661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106bc7-5700-4f87-bb1b-5eff57070233 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:23.864661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd106bc7-5700-4f87-bb1b-5eff57070233 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:23.864661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 135/265] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:23.872988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106bc7-5700-4f87-bb1b-5eff57070233 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:23.882925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bf233-adfd-4b35-a5bf-d3c3639fb271 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:23.948368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:23.969480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74f01-2c8f-4f5b-877f-a1dc761ecbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:23.970129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74f01-2c8f-4f5b-877f-a1dc761ecbff None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:23.970404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74f01-2c8f-4f5b-877f-a1dc761ecbff None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:23.970683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74f01-2c8f-4f5b-877f-a1dc761ecbff None admin] PATH_INFO: `/v3/users/9c34fb25d4494e1c8dfa8df551985880` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:23.971962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74f01-2c8f-4f5b-877f-a1dc761ecbff None admin] RBAC: Authorizing `identity:get_user(user_id=9c34fb25d4494e1c8dfa8df551985880)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:23.973584 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74f01-2c8f-4f5b-877f-a1dc761ecbff None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:23.975690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 131/266] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:23 2022] GET /identity/v3/users/9c34fb25d4494e1c8dfa8df551985880 => generated 283 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:23.976828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc467a-8143-4e72-919c-ec3ce520bd38 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:23.977137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc467a-8143-4e72-919c-ec3ce520bd38 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:23.977413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc467a-8143-4e72-919c-ec3ce520bd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:23.984202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd106bc7-5700-4f87-bb1b-5eff57070233 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:23.998034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-25bc467a-8143-4e72-919c-ec3ce520bd38 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:23.999393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-25bc467a-8143-4e72-919c-ec3ce520bd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:24.021576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e2531-fa3a-49c9-96a6-99768f3d4634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:24.022196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2531-fa3a-49c9-96a6-99768f3d4634 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.022477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2531-fa3a-49c9-96a6-99768f3d4634 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.022751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e2531-fa3a-49c9-96a6-99768f3d4634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.023662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e2531-fa3a-49c9-96a6-99768f3d4634 None admin] RBAC: Adding query filter params (role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=f1abcea21ac844edaa06b198155110b4, user.id=9c34fb25d4494e1c8dfa8df551985880) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:24.023975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e2531-fa3a-49c9-96a6-99768f3d4634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:24.025831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e2531-fa3a-49c9-96a6-99768f3d4634 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:24.032995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 136/267] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:23 2022] GET /identity/v3/role_assignments?user.id=9c34fb25d4494e1c8dfa8df551985880&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=d278ed91749c4adf9b130d08698e7933 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:24.034193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4a85-a448-4d54-b304-789723e2d451 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.034592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4a85-a448-4d54-b304-789723e2d451 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.034878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af4a85-a448-4d54-b304-789723e2d451 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.036477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 137/268] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:24.037161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af4a85-a448-4d54-b304-789723e2d451 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:24.111202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:24.129268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 132/269] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:24.130896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d3e1-7d9a-47c5-9051-c4959e160022 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.131180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d3e1-7d9a-47c5-9051-c4959e160022 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.131452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d3e1-7d9a-47c5-9051-c4959e160022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.174206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7524d3e1-7d9a-47c5-9051-c4959e160022 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:24.175515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7524d3e1-7d9a-47c5-9051-c4959e160022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:24.204039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af4a85-a448-4d54-b304-789723e2d451 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:24.243228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4646e70-addb-46a3-ace5-4957057cc0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:24.243842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4646e70-addb-46a3-ace5-4957057cc0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.244181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4646e70-addb-46a3-ace5-4957057cc0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.244457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4646e70-addb-46a3-ace5-4957057cc0f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.319137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4646e70-addb-46a3-ace5-4957057cc0f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:24.320746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4646e70-addb-46a3-ace5-4957057cc0f6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:24.346792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 133/270] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:24.369168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:24.428374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 138/271] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:24.434541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524d3e1-7d9a-47c5-9051-c4959e160022 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:24.470168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4646e70-addb-46a3-ace5-4957057cc0f6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:24.500874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:24.583601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524d3e1-7d9a-47c5-9051-c4959e160022 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:24.584232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4646e70-addb-46a3-ace5-4957057cc0f6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:24.620834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d92cd-774a-4d99-9b32-942baab2a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:24.621840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d92cd-774a-4d99-9b32-942baab2a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.621960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13d42-eb99-4c0d-85ef-bf2bd377ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:24.622441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d92cd-774a-4d99-9b32-942baab2a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.622570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13d42-eb99-4c0d-85ef-bf2bd377ab81 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.622767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13d42-eb99-4c0d-85ef-bf2bd377ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.623043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de13d42-eb99-4c0d-85ef-bf2bd377ab81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.623419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d92cd-774a-4d99-9b32-942baab2a1c9 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.624738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d92cd-774a-4d99-9b32-942baab2a1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:24.626432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d92cd-774a-4d99-9b32-942baab2a1c9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:24.628630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 134/272] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:24 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:24.634416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e352-dcdb-43dc-88a4-a6cbe8ecf100 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.635060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e352-dcdb-43dc-88a4-a6cbe8ecf100 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.635539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2e352-dcdb-43dc-88a4-a6cbe8ecf100 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.636603 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de13d42-eb99-4c0d-85ef-bf2bd377ab81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:24.638250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 135/273] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1de13d42-eb99-4c0d-85ef-bf2bd377ab81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:24.643015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:24.643962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:24.644763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 139/274] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:24.647907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13d42-eb99-4c0d-85ef-bf2bd377ab81 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:24.648398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb6b98-2690-46b9-89af-173b8a13f79b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.648684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb6b98-2690-46b9-89af-173b8a13f79b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.648974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb6b98-2690-46b9-89af-173b8a13f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.657289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:24.675754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a0fb6b98-2690-46b9-89af-173b8a13f79b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:24.677289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a0fb6b98-2690-46b9-89af-173b8a13f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:24.747027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 136/275] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:24.757815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb6b98-2690-46b9-89af-173b8a13f79b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:24.772467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de13d42-eb99-4c0d-85ef-bf2bd377ab81 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:24.811171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:24.812033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:24.812413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:24.812785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:24.813660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=f1abcea21ac844edaa06b198155110b4, user.id=9c34fb25d4494e1c8dfa8df551985880) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:24.814072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:24.815813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:24.820525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:24.823623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 140/276] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:24 2022] GET /identity/v3/role_assignments?user.id=9c34fb25d4494e1c8dfa8df551985880&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=41491b52194f43e2902307fb86036726 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:24.826581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:24.947749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb6b98-2690-46b9-89af-173b8a13f79b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:24.988464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:25.013395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.014395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.014881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.015345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.016189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:25.016636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:25.018254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:25.029579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 137/277] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:25.030819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2656ba7-287e-42d5-ad74-7cb01a4ee55e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:25.036818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:25.069338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03062a5f-b0f4-4596-971c-755f3d407ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.070139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03062a5f-b0f4-4596-971c-755f3d407ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.070456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03062a5f-b0f4-4596-971c-755f3d407ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.070706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03062a5f-b0f4-4596-971c-755f3d407ab0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.072320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03062a5f-b0f4-4596-971c-755f3d407ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:25.073768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03062a5f-b0f4-4596-971c-755f3d407ab0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:25.075760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 141/278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:25.076671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03062a5f-b0f4-4596-971c-755f3d407ab0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:25.162996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44fdf3-0c88-4358-8e3a-8a4d3bc2fc39 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:25.173099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:25.197502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979b103-113f-42e9-807d-9f7a5827f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.198211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b103-113f-42e9-807d-9f7a5827f1bd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.198393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b103-113f-42e9-807d-9f7a5827f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.198660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979b103-113f-42e9-807d-9f7a5827f1bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.206009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03062a5f-b0f4-4596-971c-755f3d407ab0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:25.210403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979b103-113f-42e9-807d-9f7a5827f1bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-0979b103-113f-42e9-807d-9f7a5827f1bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:25.216489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:25.217414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:25.218220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 138/279] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:25.218874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979b103-113f-42e9-807d-9f7a5827f1bd None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:25.246449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69927db-4e1f-4b3e-9f7f-5ff13d608d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.247083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69927db-4e1f-4b3e-9f7f-5ff13d608d6b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.247364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69927db-4e1f-4b3e-9f7f-5ff13d608d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.247703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69927db-4e1f-4b3e-9f7f-5ff13d608d6b None admin] PATH_INFO: `/v3/users/8cad2b644277447d8b27f16e28a62641` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.250429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:25.262546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69927db-4e1f-4b3e-9f7f-5ff13d608d6b None admin] RBAC: Authorizing `identity:get_user(user_id=8cad2b644277447d8b27f16e28a62641)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:25.264016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69927db-4e1f-4b3e-9f7f-5ff13d608d6b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:25.270489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 142/280] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:25 2022] GET /identity/v3/users/8cad2b644277447d8b27f16e28a62641 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:25.270489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69927db-4e1f-4b3e-9f7f-5ff13d608d6b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:25.331391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979b103-113f-42e9-807d-9f7a5827f1bd None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:25.366776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93440-823e-46b8-94ad-a6f11a4b9e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.367370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93440-823e-46b8-94ad-a6f11a4b9e54 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.367652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93440-823e-46b8-94ad-a6f11a4b9e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.367920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93440-823e-46b8-94ad-a6f11a4b9e54 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.368580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93440-823e-46b8-94ad-a6f11a4b9e54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:25.370040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93440-823e-46b8-94ad-a6f11a4b9e54 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:25.371578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69927db-4e1f-4b3e-9f7f-5ff13d608d6b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:25.408868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.409513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.409794 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.410067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.410733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:25.411036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:25.412401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:25.421037 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 143/281] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:25.421870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:25.479332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:25.490267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 139/282] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:25 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:25.491381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93440-823e-46b8-94ad-a6f11a4b9e54 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:25.530408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:25.547061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53233-0b03-453a-8721-70a80c7b8c3b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:25.585520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16df854-cb2d-482b-bf49-526189fa1b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.586471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16df854-cb2d-482b-bf49-526189fa1b65 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.586471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16df854-cb2d-482b-bf49-526189fa1b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.586719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16df854-cb2d-482b-bf49-526189fa1b65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.587424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16df854-cb2d-482b-bf49-526189fa1b65 None admin] RBAC: Adding query filter params (role.id=b63ccf0f2ba84473bd7b8ef888c937af, user.id=8cad2b644277447d8b27f16e28a62641, scope.system=all) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:25.587738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16df854-cb2d-482b-bf49-526189fa1b65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:25.589255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16df854-cb2d-482b-bf49-526189fa1b65 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:25.596182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 144/283] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Sep 5 12:11:25 2022] GET /identity/v3/role_assignments?user.id=8cad2b644277447d8b27f16e28a62641&scope.system=all&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:25.597370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6f420-23fa-44a8-87da-d81f5035d98e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.597666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6f420-23fa-44a8-87da-d81f5035d98e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.597950 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6f420-23fa-44a8-87da-d81f5035d98e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.599423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 145/284] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:25.605467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028d3d-bcee-467a-8289-807eca202f03 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.605741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028d3d-bcee-467a-8289-807eca202f03 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.606022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28028d3d-bcee-467a-8289-807eca202f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.625770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93440-823e-46b8-94ad-a6f11a4b9e54 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:25.628609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-28028d3d-bcee-467a-8289-807eca202f03 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:25.630275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-28028d3d-bcee-467a-8289-807eca202f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:25.681546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a88e1-217b-4d94-88d0-54d2bf381662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.682200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a88e1-217b-4d94-88d0-54d2bf381662 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.682479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a88e1-217b-4d94-88d0-54d2bf381662 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.682749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a88e1-217b-4d94-88d0-54d2bf381662 None admin] PATH_INFO: `/v3/users/7708cdd341a141c48ed055661bfe2bdb` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.686461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a88e1-217b-4d94-88d0-54d2bf381662 None admin] RBAC: Authorizing `identity:get_user(user_id=7708cdd341a141c48ed055661bfe2bdb)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:25.687139 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a88e1-217b-4d94-88d0-54d2bf381662 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:25.694011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 140/285] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:25 2022] GET /identity/v3/users/7708cdd341a141c48ed055661bfe2bdb => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:25.695184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a88e1-217b-4d94-88d0-54d2bf381662 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:25.735248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 146/286] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:25.835988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:25.844596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a88e1-217b-4d94-88d0-54d2bf381662 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:25.897559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342778c0-aef1-42f3-a2ef-a85a9984e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:25.898531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342778c0-aef1-42f3-a2ef-a85a9984e150 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:25.898817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342778c0-aef1-42f3-a2ef-a85a9984e150 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:25.899091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342778c0-aef1-42f3-a2ef-a85a9984e150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:25.986239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342778c0-aef1-42f3-a2ef-a85a9984e150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:25.987918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342778c0-aef1-42f3-a2ef-a85a9984e150 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:26.030514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28028d3d-bcee-467a-8289-807eca202f03 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:26.122362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:26.134166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 141/287] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:11:26.141015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342778c0-aef1-42f3-a2ef-a85a9984e150 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:26.146469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:26.256342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342778c0-aef1-42f3-a2ef-a85a9984e150 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:26.293752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b2e4-4d6d-42c5-8cd4-a0d866c0e400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:26.294389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b2e4-4d6d-42c5-8cd4-a0d866c0e400 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:26.294664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b2e4-4d6d-42c5-8cd4-a0d866c0e400 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:26.294929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2b2e4-4d6d-42c5-8cd4-a0d866c0e400 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:26.296088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2b2e4-4d6d-42c5-8cd4-a0d866c0e400 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:26.298202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2b2e4-4d6d-42c5-8cd4-a0d866c0e400 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:26.299843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 142/288] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:26 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:26.305675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b2e4-4d6d-42c5-8cd4-a0d866c0e400 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:26.351349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28028d3d-bcee-467a-8289-807eca202f03 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:26.383913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:26.399065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4982502-941f-4358-988b-c918d2bce7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:26.399705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982502-941f-4358-988b-c918d2bce7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:26.400246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982502-941f-4358-988b-c918d2bce7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:26.400939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4982502-941f-4358-988b-c918d2bce7a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:26.415179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4982502-941f-4358-988b-c918d2bce7a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d4982502-941f-4358-988b-c918d2bce7a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:26.422432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:26.423329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:26.424206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 147/289] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:26.429872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4982502-941f-4358-988b-c918d2bce7a2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:26.432041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2b2e4-4d6d-42c5-8cd4-a0d866c0e400 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:26.473270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:26.474246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:26.474749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:26.475219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:26.476675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] RBAC: Adding query filter params (role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=f1abcea21ac844edaa06b198155110b4, user.id=7708cdd341a141c48ed055661bfe2bdb) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:26.477607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:26.479549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:26.494120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 143/290] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:26 2022] GET /identity/v3/role_assignments?user.id=7708cdd341a141c48ed055661bfe2bdb&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:26.575436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4982502-941f-4358-988b-c918d2bce7a2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:26.587324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:26.616482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:26.617128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:26.620174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:26.620174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:26.620174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:26.620174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:26.620174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:26.629578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 148/291] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:26.635158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:26.777030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e47619-655d-4c60-8abc-6fafa04261e9 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:26.802302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:26.818662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45382367-2f1c-4f01-998c-86488a57ddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:26.819353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45382367-2f1c-4f01-998c-86488a57ddf8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:26.819638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45382367-2f1c-4f01-998c-86488a57ddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:26.819969 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45382367-2f1c-4f01-998c-86488a57ddf8 None admin] PATH_INFO: `/v3/users/e3c6789cf495432597406196de06f173` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:26.821180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45382367-2f1c-4f01-998c-86488a57ddf8 None admin] RBAC: Authorizing `identity:get_user(user_id=e3c6789cf495432597406196de06f173)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:26.822624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45382367-2f1c-4f01-998c-86488a57ddf8 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:26.825135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 144/292] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:26 2022] GET /identity/v3/users/e3c6789cf495432597406196de06f173 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:26.830984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:26.937918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976ba3-9c61-4755-8336-2c2624ee306f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:26.973107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7350db7-b303-4215-895b-7ab0a6a70579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:26.973739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350db7-b303-4215-895b-7ab0a6a70579 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:26.974016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350db7-b303-4215-895b-7ab0a6a70579 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:26.974284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7350db7-b303-4215-895b-7ab0a6a70579 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:26.975420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7350db7-b303-4215-895b-7ab0a6a70579 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:26.976853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7350db7-b303-4215-895b-7ab0a6a70579 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:26.978779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 149/293] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:26 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:26.984481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45382367-2f1c-4f01-998c-86488a57ddf8 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:27.099300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45382367-2f1c-4f01-998c-86488a57ddf8 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:27.137327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e92063-d4dc-4855-b206-018ed3af1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:27.138070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e92063-d4dc-4855-b206-018ed3af1f04 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:27.138404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e92063-d4dc-4855-b206-018ed3af1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:27.138613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e92063-d4dc-4855-b206-018ed3af1f04 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4/users/e3c6789cf495432597406196de06f173/roles/e9faf0d531a54b68be17731e1203edf3` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:27.140543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e92063-d4dc-4855-b206-018ed3af1f04 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1abcea21ac844edaa06b198155110b4, user_id=e3c6789cf495432597406196de06f173, role_id=e9faf0d531a54b68be17731e1203edf3)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:27.142014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e92063-d4dc-4855-b206-018ed3af1f04 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:27.239795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 145/294] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:11:26 2022] PUT /identity/v3/projects/f1abcea21ac844edaa06b198155110b4/users/e3c6789cf495432597406196de06f173/roles/e9faf0d531a54b68be17731e1203edf3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:27.713458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea4cb-3df6-4aa9-8676-d3f5b8da1862 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:27.714476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea4cb-3df6-4aa9-8676-d3f5b8da1862 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:27.715563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea4cb-3df6-4aa9-8676-d3f5b8da1862 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:27.717427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 150/295] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:27.722897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4215e-ef57-4100-ad16-50a1ebd06024 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:27.723737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4215e-ef57-4100-ad16-50a1ebd06024 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:27.724214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4215e-ef57-4100-ad16-50a1ebd06024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:27.742774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-32b4215e-ef57-4100-ad16-50a1ebd06024 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:27.744342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-32b4215e-ef57-4100-ad16-50a1ebd06024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:27.795906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:27.816605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 146/296] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:27.955804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77032b-5d16-4017-aba2-63ea199f24af None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:27.956445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77032b-5d16-4017-aba2-63ea199f24af None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:27.956970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77032b-5d16-4017-aba2-63ea199f24af None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:27.958786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 151/297] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:27.963794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea0cfd-15dd-488b-83e3-9ccab2b3bae4 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:27.964332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea0cfd-15dd-488b-83e3-9ccab2b3bae4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:27.964840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea0cfd-15dd-488b-83e3-9ccab2b3bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:27.983591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b4ea0cfd-15dd-488b-83e3-9ccab2b3bae4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:27.985149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b4ea0cfd-15dd-488b-83e3-9ccab2b3bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:28.054276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 147/298] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:28.100481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77032b-5d16-4017-aba2-63ea199f24af None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:28.106395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8dce-0246-4b5d-9ffb-b8cd67b60b3c None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.107042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8dce-0246-4b5d-9ffb-b8cd67b60b3c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.107516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d8dce-0246-4b5d-9ffb-b8cd67b60b3c None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.114385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 148/299] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:11:28.120549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9e513-652d-4e85-a987-b9d9bbfb4bfc None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.120832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9e513-652d-4e85-a987-b9d9bbfb4bfc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.121720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9e513-652d-4e85-a987-b9d9bbfb4bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.153392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-3ad9e513-652d-4e85-a987-b9d9bbfb4bfc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:28.155845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3ad9e513-652d-4e85-a987-b9d9bbfb4bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:28.162463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:28.239007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77032b-5d16-4017-aba2-63ea199f24af None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:28.256986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 149/300] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:28.282853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d85180-4435-424e-901a-ca791b33da8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:28.283503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d85180-4435-424e-901a-ca791b33da8e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.283784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d85180-4435-424e-901a-ca791b33da8e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.284058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d85180-4435-424e-901a-ca791b33da8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.295031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d85180-4435-424e-901a-ca791b33da8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-83d85180-4435-424e-901a-ca791b33da8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:28.300388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:28.301282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:28.302079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 152/301] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:28.310066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9e513-652d-4e85-a987-b9d9bbfb4bfc None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:28.343291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d85180-4435-424e-901a-ca791b33da8e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:28.358299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:28.417453 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9e513-652d-4e85-a987-b9d9bbfb4bfc None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:28.454760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:28.455617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.456047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.456503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.457352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:28.457480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:28.457914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:28.459460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:28.461010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d85180-4435-424e-901a-ca791b33da8e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:28.473103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 150/302] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:28.480257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:28.515898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9f946-6847-44c5-b19f-5f118994f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:28.517191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9f946-6847-44c5-b19f-5f118994f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.518111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9f946-6847-44c5-b19f-5f118994f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.519373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9f946-6847-44c5-b19f-5f118994f0d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.539334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9f946-6847-44c5-b19f-5f118994f0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-53c9f946-6847-44c5-b19f-5f118994f0d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:28.546889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:28.547808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:28.548588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:28.553025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 153/303] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:28.554060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9f946-6847-44c5-b19f-5f118994f0d4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:28.603868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6f55a-70d3-4ee3-8715-e72705006dcc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:28.607033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:28.644068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a879-e7eb-4ee5-a332-b4884af5968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:28.644975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a879-e7eb-4ee5-a332-b4884af5968d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.645433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a879-e7eb-4ee5-a332-b4884af5968d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.645854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4a879-e7eb-4ee5-a332-b4884af5968d None admin] PATH_INFO: `/v3/users/8cad2b644277447d8b27f16e28a62641` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.647142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a879-e7eb-4ee5-a332-b4884af5968d None admin] RBAC: Authorizing `identity:get_user(user_id=8cad2b644277447d8b27f16e28a62641)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:28.648734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4a879-e7eb-4ee5-a332-b4884af5968d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:28.650746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 151/304] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:28 2022] GET /identity/v3/users/8cad2b644277447d8b27f16e28a62641 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:28.656143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a879-e7eb-4ee5-a332-b4884af5968d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:28.675335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9f946-6847-44c5-b19f-5f118994f0d4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:28.716459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d883b5-966d-4513-b3a8-cc53a2825afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:28.717125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d883b5-966d-4513-b3a8-cc53a2825afb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.717400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d883b5-966d-4513-b3a8-cc53a2825afb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.717684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d883b5-966d-4513-b3a8-cc53a2825afb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.718872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d883b5-966d-4513-b3a8-cc53a2825afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:28.720345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d883b5-966d-4513-b3a8-cc53a2825afb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:28.722092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 154/305] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:28.722667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d883b5-966d-4513-b3a8-cc53a2825afb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:28.756633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:28.771254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4a879-e7eb-4ee5-a332-b4884af5968d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:28.806350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:28.807201 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.807631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.808212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.810866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:28.811208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:28.812698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:28.829954 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 152/306] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:28.829954 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:28.846718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d883b5-966d-4513-b3a8-cc53a2825afb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:28.879386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:28.892262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e94ba-f69f-48bd-ac29-7598350329d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:28.892921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e94ba-f69f-48bd-ac29-7598350329d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.894026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e94ba-f69f-48bd-ac29-7598350329d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.894026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e94ba-f69f-48bd-ac29-7598350329d9 None admin] PATH_INFO: `/v3/system/users/8cad2b644277447d8b27f16e28a62641/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.894989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e94ba-f69f-48bd-ac29-7598350329d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8cad2b644277447d8b27f16e28a62641, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:28.896430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e94ba-f69f-48bd-ac29-7598350329d9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:28.950261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46de750-820c-4b97-bc3d-8c1f3d0fbeb2 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:28.984352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48627-eda2-4322-9b75-06a679c79d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:28.984994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48627-eda2-4322-9b75-06a679c79d23 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:28.985281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48627-eda2-4322-9b75-06a679c79d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:28.985550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48627-eda2-4322-9b75-06a679c79d23 None admin] PATH_INFO: `/v3/groups` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:28.986182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e48627-eda2-4322-9b75-06a679c79d23 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:28.987614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e48627-eda2-4322-9b75-06a679c79d23 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:28.993611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 155/307] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Sep 5 12:11:28 2022] PUT /identity/v3/system/users/8cad2b644277447d8b27f16e28a62641/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:28.994667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e94ba-f69f-48bd-ac29-7598350329d9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:29.075908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 153/308] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Sep 5 12:11:28 2022] POST /identity/v3/groups => generated 229 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:29.116704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:29.128261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e94ba-f69f-48bd-ac29-7598350329d9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:29.170954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b887fd-b73b-4b44-8f23-b5719f7e678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:29.171621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b887fd-b73b-4b44-8f23-b5719f7e678d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:29.171902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b887fd-b73b-4b44-8f23-b5719f7e678d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:29.172178 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b887fd-b73b-4b44-8f23-b5719f7e678d None admin] PATH_INFO: `/v3/users/1817810e396040b68c6fd137a982c915` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:29.188767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b887fd-b73b-4b44-8f23-b5719f7e678d None admin] RBAC: Authorizing `identity:get_user(user_id=1817810e396040b68c6fd137a982c915)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:29.190326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b887fd-b73b-4b44-8f23-b5719f7e678d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:29.192092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 156/309] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:28 2022] GET /identity/v3/users/1817810e396040b68c6fd137a982c915 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:29.198634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48627-eda2-4322-9b75-06a679c79d23 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:29.308901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa77b-f265-4e57-824a-b2ce1c21366d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:29.309294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa77b-f265-4e57-824a-b2ce1c21366d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:29.309579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa77b-f265-4e57-824a-b2ce1c21366d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:29.310939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 157/310] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:11:29.311315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:29.317517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48627-eda2-4322-9b75-06a679c79d23 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:29.317681 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd123-eca1-4be0-95f3-75454c0ff55e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:29.317979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd123-eca1-4be0-95f3-75454c0ff55e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:29.318151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd123-eca1-4be0-95f3-75454c0ff55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:29.338094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-862bd123-eca1-4be0-95f3-75454c0ff55e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:29.339189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-862bd123-eca1-4be0-95f3-75454c0ff55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:29.356455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:29.357524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:29.358009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:29.358468 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:29.359407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] RBAC: Adding query filter params (role.id=e9faf0d531a54b68be17731e1203edf3, user.id=1817810e396040b68c6fd137a982c915, scope.system=all) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:29.359926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:29.361579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:29.367615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 154/311] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Sep 5 12:11:29 2022] GET /identity/v3/role_assignments?user.id=1817810e396040b68c6fd137a982c915&scope.system=all&role.id=e9faf0d531a54b68be17731e1203edf3 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:29.423522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 158/312] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:29.697923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:29.801700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272c3b4-8db9-4c51-a0e7-4d8944f181cf None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:29.837592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e830a-f54a-4bad-8b84-46a8ec28d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:29.838588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e830a-f54a-4bad-8b84-46a8ec28d31f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:29.838866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e830a-f54a-4bad-8b84-46a8ec28d31f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:29.839134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e830a-f54a-4bad-8b84-46a8ec28d31f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:29.852821 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e830a-f54a-4bad-8b84-46a8ec28d31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-0c5e830a-f54a-4bad-8b84-46a8ec28d31f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:29.859503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:29.860799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:29.861633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 155/313] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:29.867314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd123-eca1-4be0-95f3-75454c0ff55e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:29.957532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:29.977692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd123-eca1-4be0-95f3-75454c0ff55e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:30.013014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:30.013753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:30.014453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:30.014725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:30.015388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:30.015690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:30.017145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:30.026205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 159/314] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:30.032191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e830a-f54a-4bad-8b84-46a8ec28d31f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:30.053286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:30.138213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e830a-f54a-4bad-8b84-46a8ec28d31f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:30.173003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0d485-9f31-42f9-b010-021a982f9828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:30.173644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d485-9f31-42f9-b010-021a982f9828 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:30.173923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d485-9f31-42f9-b010-021a982f9828 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:30.174195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d485-9f31-42f9-b010-021a982f9828 None admin] PATH_INFO: `/v3/users/e3c6789cf495432597406196de06f173` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:30.175335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0d485-9f31-42f9-b010-021a982f9828 None admin] RBAC: Authorizing `identity:get_user(user_id=e3c6789cf495432597406196de06f173)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:30.176775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0d485-9f31-42f9-b010-021a982f9828 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:30.178680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 156/315] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:30 2022] GET /identity/v3/users/e3c6789cf495432597406196de06f173 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:30.184419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:30.290580 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfa8d0-9829-43aa-8bc1-e613094b5e16 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:30.326924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06627643-fd90-4fa0-89bd-e466c6dbdea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:30.327535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06627643-fd90-4fa0-89bd-e466c6dbdea6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:30.327814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06627643-fd90-4fa0-89bd-e466c6dbdea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:30.328084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06627643-fd90-4fa0-89bd-e466c6dbdea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:30.344515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:30.398338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06627643-fd90-4fa0-89bd-e466c6dbdea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:30.399783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06627643-fd90-4fa0-89bd-e466c6dbdea6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:30.503078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 160/316] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:30.508671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0d485-9f31-42f9-b010-021a982f9828 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:30.600590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:30.615866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0d485-9f31-42f9-b010-021a982f9828 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:30.651112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59fa6d-894d-46c5-bb0f-134c5a471231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:30.651741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fa6d-894d-46c5-bb0f-134c5a471231 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:30.652019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fa6d-894d-46c5-bb0f-134c5a471231 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:30.652892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59fa6d-894d-46c5-bb0f-134c5a471231 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:30.654063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59fa6d-894d-46c5-bb0f-134c5a471231 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:30.655492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e59fa6d-894d-46c5-bb0f-134c5a471231 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:30.657482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 157/317] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:30 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:30.663377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06627643-fd90-4fa0-89bd-e466c6dbdea6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:30.707338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:30.766095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06627643-fd90-4fa0-89bd-e466c6dbdea6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:30.801342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec5b30-61be-4877-b642-a88fd35c91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:30.801951 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec5b30-61be-4877-b642-a88fd35c91d5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:30.802230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec5b30-61be-4877-b642-a88fd35c91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:30.802563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec5b30-61be-4877-b642-a88fd35c91d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:30.803297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec5b30-61be-4877-b642-a88fd35c91d5 None admin] RBAC: Adding query filter params (role.id=e9faf0d531a54b68be17731e1203edf3, scope.project.id=f1abcea21ac844edaa06b198155110b4, user.id=e3c6789cf495432597406196de06f173) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:30.803604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec5b30-61be-4877-b642-a88fd35c91d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:30.805060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec5b30-61be-4877-b642-a88fd35c91d5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:30.812048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 161/318] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:30 2022] GET /identity/v3/role_assignments?user.id=e3c6789cf495432597406196de06f173&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=e9faf0d531a54b68be17731e1203edf3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:30.956488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157366-47d4-4e00-9e5b-a476a5ff2801 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:30.957003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157366-47d4-4e00-9e5b-a476a5ff2801 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:30.957003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db157366-47d4-4e00-9e5b-a476a5ff2801 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:30.958421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 158/319] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:30.963873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271991d-ba7b-4279-86e8-9fe846d7e9bb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:30.965282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271991d-ba7b-4279-86e8-9fe846d7e9bb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:30.965764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271991d-ba7b-4279-86e8-9fe846d7e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:30.987085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e271991d-ba7b-4279-86e8-9fe846d7e9bb None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:30.988627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e271991d-ba7b-4279-86e8-9fe846d7e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:31.065827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 162/320] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:31.163255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b1ca6-9b20-49b2-abb0-d333df13497e None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.163566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b1ca6-9b20-49b2-abb0-d333df13497e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.163804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b1ca6-9b20-49b2-abb0-d333df13497e None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.165308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 159/321] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:31.170334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc497fca-dbef-4394-b773-9dbd4e27b3a9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.170622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc497fca-dbef-4394-b773-9dbd4e27b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.170897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc497fca-dbef-4394-b773-9dbd4e27b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.189380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cc497fca-dbef-4394-b773-9dbd4e27b3a9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:31.190553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cc497fca-dbef-4394-b773-9dbd4e27b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:31.225246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:31.262942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 163/322] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:31.327566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efa03-0e33-4ee3-859a-b4048356c090 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.327954 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efa03-0e33-4ee3-859a-b4048356c090 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.328309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efa03-0e33-4ee3-859a-b4048356c090 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.329819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 160/323] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:31.335520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ee1c-7094-4cb1-ace0-f17baf89c981 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.335883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ee1c-7094-4cb1-ace0-f17baf89c981 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.336166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ee1c-7094-4cb1-ace0-f17baf89c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.336264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778efa03-0e33-4ee3-859a-b4048356c090 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:31.355130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-14c8ee1c-7094-4cb1-ace0-f17baf89c981 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:31.356865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-14c8ee1c-7094-4cb1-ace0-f17baf89c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:31.433460 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 164/324] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:31.449110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778efa03-0e33-4ee3-859a-b4048356c090 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:31.483722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c4cef-5508-4f2f-9c78-6972c9363524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:31.484670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c4cef-5508-4f2f-9c78-6972c9363524 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.485202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c4cef-5508-4f2f-9c78-6972c9363524 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.485693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c4cef-5508-4f2f-9c78-6972c9363524 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.497023 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c4cef-5508-4f2f-9c78-6972c9363524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ed2c4cef-5508-4f2f-9c78-6972c9363524 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:31.502804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:31.503739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:31.504537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:31.506466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 161/325] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:31.511980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ee1c-7094-4cb1-ace0-f17baf89c981 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:31.532043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c4cef-5508-4f2f-9c78-6972c9363524 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:31.548333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:31.612973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:31.620264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ee1c-7094-4cb1-ace0-f17baf89c981 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:31.634746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c4cef-5508-4f2f-9c78-6972c9363524 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:31.658433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:31.659046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.659330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.659599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.660271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:31.660574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:31.661991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:31.670627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014d06d-a16d-4977-b882-d5242f80d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:31.670814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 165/326] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:31.671552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014d06d-a16d-4977-b882-d5242f80d7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.671961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014d06d-a16d-4977-b882-d5242f80d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.672364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014d06d-a16d-4977-b882-d5242f80d7e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.673688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014d06d-a16d-4977-b882-d5242f80d7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:31.675267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014d06d-a16d-4977-b882-d5242f80d7e5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:31.676065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:31.677160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 162/327] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:31.682544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014d06d-a16d-4977-b882-d5242f80d7e5 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:31.763861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:31.779838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830ebcf-1da9-42c4-aa16-a7e74b6e1c99 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:31.781385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014d06d-a16d-4977-b882-d5242f80d7e5 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:31.814791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6d06-23f7-48a4-8a65-b14abb78e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:31.815417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55761c-ecef-4e72-817c-bfc8ccbf937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:31.815679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6d06-23f7-48a4-8a65-b14abb78e8ec None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.815962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6d06-23f7-48a4-8a65-b14abb78e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.816091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55761c-ecef-4e72-817c-bfc8ccbf937e None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.816241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6d06-23f7-48a4-8a65-b14abb78e8ec None admin] PATH_INFO: `/v3/users/8cad2b644277447d8b27f16e28a62641` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.816361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55761c-ecef-4e72-817c-bfc8ccbf937e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.816551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55761c-ecef-4e72-817c-bfc8ccbf937e None admin] PATH_INFO: `/v3/groups` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.817213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55761c-ecef-4e72-817c-bfc8ccbf937e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:31.817460 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d6d06-23f7-48a4-8a65-b14abb78e8ec None admin] RBAC: Authorizing `identity:get_user(user_id=8cad2b644277447d8b27f16e28a62641)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:31.818647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55761c-ecef-4e72-817c-bfc8ccbf937e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:31.818897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d6d06-23f7-48a4-8a65-b14abb78e8ec None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:31.820468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 166/328] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:31 2022] GET /identity/v3/users/8cad2b644277447d8b27f16e28a62641 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:31.823517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6d06-23f7-48a4-8a65-b14abb78e8ec None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:31.851498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:31.924103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 163/329] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Sep 5 12:11:31 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:11:31.925695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55761c-ecef-4e72-817c-bfc8ccbf937e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:31.939509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6d06-23f7-48a4-8a65-b14abb78e8ec None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:31.981680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151b02-2efa-4b45-b06a-9968d2949753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:31.982382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151b02-2efa-4b45-b06a-9968d2949753 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:31.982612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151b02-2efa-4b45-b06a-9968d2949753 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:31.982885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151b02-2efa-4b45-b06a-9968d2949753 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:31.997308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb151b02-2efa-4b45-b06a-9968d2949753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-fb151b02-2efa-4b45-b06a-9968d2949753 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:32.002546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:32.003808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:32.004622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 167/330] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:32.009784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151b02-2efa-4b45-b06a-9968d2949753 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:32.066290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55761c-ecef-4e72-817c-bfc8ccbf937e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:32.106668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:32.107298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:32.107570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:32.107846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:32.108570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] RBAC: Adding query filter params (role.id=b63ccf0f2ba84473bd7b8ef888c937af, user.id=8cad2b644277447d8b27f16e28a62641, scope.system=all) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:32.108877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:32.110427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:32.115238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:32.120013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:32.126793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 164/331] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Sep 5 12:11:31 2022] GET /identity/v3/role_assignments?user.id=8cad2b644277447d8b27f16e28a62641&scope.system=all&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:32.130412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151b02-2efa-4b45-b06a-9968d2949753 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:32.172680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:32.173349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:32.173632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:32.173906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:32.174627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:32.175023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:32.176337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:32.186452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 168/332] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:32.192407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:32.320158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8a89-18e1-49e4-a16c-0a7f0d0081d1 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:32.358425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1137c-7069-49e1-9867-bef6dfa17690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:32.359048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1137c-7069-49e1-9867-bef6dfa17690 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:32.359328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1137c-7069-49e1-9867-bef6dfa17690 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:32.359600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1137c-7069-49e1-9867-bef6dfa17690 None admin] PATH_INFO: `/v3/users/1817810e396040b68c6fd137a982c915` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:32.360752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1137c-7069-49e1-9867-bef6dfa17690 None admin] RBAC: Authorizing `identity:get_user(user_id=1817810e396040b68c6fd137a982c915)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:32.362240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1137c-7069-49e1-9867-bef6dfa17690 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:32.363827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 165/333] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:32 2022] GET /identity/v3/users/1817810e396040b68c6fd137a982c915 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:32.369660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:32.482602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da917c-64d5-4f29-9d87-2a011ac0a756 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:32.522641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032eae5-8b55-4fbd-838a-9037cf6ce57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:32.523297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032eae5-8b55-4fbd-838a-9037cf6ce57c None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:32.523574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032eae5-8b55-4fbd-838a-9037cf6ce57c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:32.523847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032eae5-8b55-4fbd-838a-9037cf6ce57c None admin] PATH_INFO: `/v3/system/users/1817810e396040b68c6fd137a982c915/roles/e9faf0d531a54b68be17731e1203edf3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:32.525604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032eae5-8b55-4fbd-838a-9037cf6ce57c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1817810e396040b68c6fd137a982c915, role_id=e9faf0d531a54b68be17731e1203edf3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:32.526976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032eae5-8b55-4fbd-838a-9037cf6ce57c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:32.616239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 169/334] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Sep 5 12:11:32 2022] PUT /identity/v3/system/users/1817810e396040b68c6fd137a982c915/roles/e9faf0d531a54b68be17731e1203edf3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:34.480414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96b2f-3187-4417-aa2e-3f5b7600ce08 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:34.480936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96b2f-3187-4417-aa2e-3f5b7600ce08 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:34.480936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c96b2f-3187-4417-aa2e-3f5b7600ce08 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:34.482337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 166/335] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:34.495025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1fbc-f888-4a86-9bc3-f30dcd04676a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:34.495536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1fbc-f888-4a86-9bc3-f30dcd04676a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:34.495610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1fbc-f888-4a86-9bc3-f30dcd04676a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:34.497164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 170/336] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:34.499078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf327bb-8ff2-4658-8122-1b5e6e0453c6 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:34.499371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf327bb-8ff2-4658-8122-1b5e6e0453c6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:34.499650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf327bb-8ff2-4658-8122-1b5e6e0453c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:34.504081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f71e2-b775-4e69-ba8f-2f73ce2dd94a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:34.504367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f71e2-b775-4e69-ba8f-2f73ce2dd94a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:34.504644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f71e2-b775-4e69-ba8f-2f73ce2dd94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:34.534680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-bdf327bb-8ff2-4658-8122-1b5e6e0453c6 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:34.535899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bdf327bb-8ff2-4658-8122-1b5e6e0453c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:34.547517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-344f71e2-b775-4e69-ba8f-2f73ce2dd94a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:34.548742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-344f71e2-b775-4e69-ba8f-2f73ce2dd94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:34.566754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:34.705351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:34.720412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 167/337] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:34.728517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 171/338] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:35.066148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373398-f320-4ae2-8f29-cc344c009d18 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:35.066539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373398-f320-4ae2-8f29-cc344c009d18 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:35.066727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373398-f320-4ae2-8f29-cc344c009d18 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:35.068144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 168/339] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:35.073686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a369a-bf37-48ac-8b38-2a624e6ba9f9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:35.074065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a369a-bf37-48ac-8b38-2a624e6ba9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:35.074282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a369a-bf37-48ac-8b38-2a624e6ba9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:35.097952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-213a369a-bf37-48ac-8b38-2a624e6ba9f9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:35.099164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-213a369a-bf37-48ac-8b38-2a624e6ba9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:35.177918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7373398-f320-4ae2-8f29-cc344c009d18 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:35.194655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 172/340] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:35.344798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7373398-f320-4ae2-8f29-cc344c009d18 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:35.382421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f200-01d3-45ad-bd6e-03d4e7c27aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:35.382990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f200-01d3-45ad-bd6e-03d4e7c27aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:35.383276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f200-01d3-45ad-bd6e-03d4e7c27aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:35.383550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f200-01d3-45ad-bd6e-03d4e7c27aa1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:35.402414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510f200-01d3-45ad-bd6e-03d4e7c27aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-9510f200-01d3-45ad-bd6e-03d4e7c27aa1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:35.407422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:35.408368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:35.409212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 169/341] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:35.416191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a369a-bf37-48ac-8b38-2a624e6ba9f9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:35.426899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f200-01d3-45ad-bd6e-03d4e7c27aa1 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:35.526614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:35.556561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:35.606328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f200-01d3-45ad-bd6e-03d4e7c27aa1 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:35.610554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a369a-bf37-48ac-8b38-2a624e6ba9f9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:35.659030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d967fd6-3ad5-4492-b5ce-0a10c930408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:35.659587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d967fd6-3ad5-4492-b5ce-0a10c930408f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:35.659868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d967fd6-3ad5-4492-b5ce-0a10c930408f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:35.660128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d967fd6-3ad5-4492-b5ce-0a10c930408f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:35.678980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4dda7-dbd5-41db-a272-849f3f610d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:35.679596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4dda7-dbd5-41db-a272-849f3f610d5a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:35.679878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4dda7-dbd5-41db-a272-849f3f610d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:35.680237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4dda7-dbd5-41db-a272-849f3f610d5a None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:35.680935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4dda7-dbd5-41db-a272-849f3f610d5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:35.681298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4dda7-dbd5-41db-a272-849f3f610d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:35.682123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d967fd6-3ad5-4492-b5ce-0a10c930408f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:35.682676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4dda7-dbd5-41db-a272-849f3f610d5a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-5d967fd6-3ad5-4492-b5ce-0a10c930408f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:35.687823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:35.688723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:35.689557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 170/342] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:35.690683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446655c-134f-4699-8ff1-e60584483da1 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:35.690788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446655c-134f-4699-8ff1-e60584483da1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:35.692614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446655c-134f-4699-8ff1-e60584483da1 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:35.692614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 171/343] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:35.692997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 173/344] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:35.697677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446655c-134f-4699-8ff1-e60584483da1 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:35.698363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312730c-0976-4f7a-ac80-14251c83dca4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:35.698878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312730c-0976-4f7a-ac80-14251c83dca4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:35.699687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312730c-0976-4f7a-ac80-14251c83dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:35.724379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3312730c-0976-4f7a-ac80-14251c83dca4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:35.725537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3312730c-0976-4f7a-ac80-14251c83dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:35.807021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 174/345] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:35.807971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312730c-0976-4f7a-ac80-14251c83dca4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:35.862558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446655c-134f-4699-8ff1-e60584483da1 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:35.892129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:35.893718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:35.921101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7244f8a-2458-4cab-b5c9-2c9b8bc5e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:35.921101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7244f8a-2458-4cab-b5c9-2c9b8bc5e0ba None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:35.921101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7244f8a-2458-4cab-b5c9-2c9b8bc5e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:35.921101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7244f8a-2458-4cab-b5c9-2c9b8bc5e0ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:35.926509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7244f8a-2458-4cab-b5c9-2c9b8bc5e0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-a7244f8a-2458-4cab-b5c9-2c9b8bc5e0ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:35.931580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:35.932592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:35.933505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:35.934607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 172/346] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:35.935304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7244f8a-2458-4cab-b5c9-2c9b8bc5e0ba None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:35.967775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312730c-0976-4f7a-ac80-14251c83dca4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:36.013612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eea57-d2f2-4b74-a221-1fd0ca38429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:36.014471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eea57-d2f2-4b74-a221-1fd0ca38429d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.014887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eea57-d2f2-4b74-a221-1fd0ca38429d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.015320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eea57-d2f2-4b74-a221-1fd0ca38429d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.086661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7244f8a-2458-4cab-b5c9-2c9b8bc5e0ba None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:36.102502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eea57-d2f2-4b74-a221-1fd0ca38429d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:36.104227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eea57-d2f2-4b74-a221-1fd0ca38429d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:36.133056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d19758-cd79-4960-a312-d3326e1f378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:36.134380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d19758-cd79-4960-a312-d3326e1f378c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.135117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d19758-cd79-4960-a312-d3326e1f378c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.135829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d19758-cd79-4960-a312-d3326e1f378c None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.137463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d19758-cd79-4960-a312-d3326e1f378c None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:36.137976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d19758-cd79-4960-a312-d3326e1f378c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:36.142497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d19758-cd79-4960-a312-d3326e1f378c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:36.165019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 173/347] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:36.165019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b215d-9d48-4375-a175-f5d1aba73b40 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.165019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b215d-9d48-4375-a175-f5d1aba73b40 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.165494 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b215d-9d48-4375-a175-f5d1aba73b40 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.166478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 174/348] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:36.167353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b215d-9d48-4375-a175-f5d1aba73b40 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:36.181277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:36.226158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:36.239677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 175/349] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:36.240886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eea57-d2f2-4b74-a221-1fd0ca38429d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:36.313849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b215d-9d48-4375-a175-f5d1aba73b40 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:36.361881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:36.362500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.362786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.363061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.364544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:36.364544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:36.365525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:36.377977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eea57-d2f2-4b74-a221-1fd0ca38429d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:36.378988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 175/350] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:36.379851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:36.435989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ad101-b98a-467b-b01c-688b3d013d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:36.435989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad101-b98a-467b-b01c-688b3d013d4a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.435989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad101-b98a-467b-b01c-688b3d013d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.435989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad101-b98a-467b-b01c-688b3d013d4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.446019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ad101-b98a-467b-b01c-688b3d013d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-050ad101-b98a-467b-b01c-688b3d013d4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:36.451187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:36.452110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:36.452936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 176/351] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:36.454294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9acd79-5e51-4b31-be2e-c31de81dd2ce None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.454401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9acd79-5e51-4b31-be2e-c31de81dd2ce None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.455230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9acd79-5e51-4b31-be2e-c31de81dd2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.476323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ca9acd79-5e51-4b31-be2e-c31de81dd2ce None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:36.477697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ca9acd79-5e51-4b31-be2e-c31de81dd2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:36.499339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:36.528166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc39b2d-15b8-4d31-8757-ea7a2aa37c8f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:36.531559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:36.563666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 177/352] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:36.565421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9acd79-5e51-4b31-be2e-c31de81dd2ce None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:36.578742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a9805-4fd0-4ca3-bb32-5dec38d4a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:36.579702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a9805-4fd0-4ca3-bb32-5dec38d4a3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.579982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a9805-4fd0-4ca3-bb32-5dec38d4a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.580255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a9805-4fd0-4ca3-bb32-5dec38d4a3c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.678385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a9805-4fd0-4ca3-bb32-5dec38d4a3c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:36.680565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a9805-4fd0-4ca3-bb32-5dec38d4a3c8 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:36.727074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9acd79-5e51-4b31-be2e-c31de81dd2ce None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:36.788281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66751d4f-3dc7-4ba0-91c2-fcd2633680f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:36.788976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66751d4f-3dc7-4ba0-91c2-fcd2633680f6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.789251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66751d4f-3dc7-4ba0-91c2-fcd2633680f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.789521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66751d4f-3dc7-4ba0-91c2-fcd2633680f6 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.790653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66751d4f-3dc7-4ba0-91c2-fcd2633680f6 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:36.792101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66751d4f-3dc7-4ba0-91c2-fcd2633680f6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:36.795825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 178/353] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:36 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:36.795825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66751d4f-3dc7-4ba0-91c2-fcd2633680f6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:36.823320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 176/354] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:36.825537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b58f8-045f-47b7-b989-c0d80b5183ed None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.825823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b58f8-045f-47b7-b989-c0d80b5183ed None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.825969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:36.826072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b58f8-045f-47b7-b989-c0d80b5183ed None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:36.827726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 177/355] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:36.828472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b58f8-045f-47b7-b989-c0d80b5183ed None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:36.836288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:36.927588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66751d4f-3dc7-4ba0-91c2-fcd2633680f6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:36.968282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b58f8-045f-47b7-b989-c0d80b5183ed None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:36.969596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e46e-dbdf-480d-ad9f-478d255e1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:36.970387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e46e-dbdf-480d-ad9f-478d255e1b7b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:36.970671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e46e-dbdf-480d-ad9f-478d255e1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:36.971593 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875e46e-dbdf-480d-ad9f-478d255e1b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.015604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:37.016142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.016421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.016689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.017895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:37.018220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:37.020735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:37.030164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 178/356] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:37.030992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.051241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875e46e-dbdf-480d-ad9f-478d255e1b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:37.053112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875e46e-dbdf-480d-ad9f-478d255e1b7b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:37.082706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:37.106795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:37.163845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88185c3-ffe7-4421-a10b-9a555eadd98b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:37.190879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 179/357] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:37.191738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e46e-dbdf-480d-ad9f-478d255e1b7b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.210736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23825fab-25e2-4654-a3d2-3c35ac2a0485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:37.210736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825fab-25e2-4654-a3d2-3c35ac2a0485 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.210736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825fab-25e2-4654-a3d2-3c35ac2a0485 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.210736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825fab-25e2-4654-a3d2-3c35ac2a0485 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.220980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23825fab-25e2-4654-a3d2-3c35ac2a0485 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:37.223731 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23825fab-25e2-4654-a3d2-3c35ac2a0485 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:37.227135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 179/358] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:37.229080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280246-c044-493e-98fd-ce49b51c278e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.229599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280246-c044-493e-98fd-ce49b51c278e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.230764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280246-c044-493e-98fd-ce49b51c278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.251402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4c280246-c044-493e-98fd-ce49b51c278e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:37.252675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4c280246-c044-493e-98fd-ce49b51c278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:37.337017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875e46e-dbdf-480d-ad9f-478d255e1b7b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:37.343314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 180/359] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:37.344191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280246-c044-493e-98fd-ce49b51c278e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.368531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:37.384912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c5313-44cb-43d9-a36d-edd08f7da3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:37.385651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5313-44cb-43d9-a36d-edd08f7da3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.385933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5313-44cb-43d9-a36d-edd08f7da3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.386234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5313-44cb-43d9-a36d-edd08f7da3d2 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.387572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c5313-44cb-43d9-a36d-edd08f7da3d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:37.388884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c5313-44cb-43d9-a36d-edd08f7da3d2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:37.390634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 180/360] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:37.392382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c5313-44cb-43d9-a36d-edd08f7da3d2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.429686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:37.486030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280246-c044-493e-98fd-ce49b51c278e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:37.524180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eea995-8c5c-4e17-9d08-7d0de4a97d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:37.524830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea995-8c5c-4e17-9d08-7d0de4a97d7c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.525406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea995-8c5c-4e17-9d08-7d0de4a97d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.525687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea995-8c5c-4e17-9d08-7d0de4a97d7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.531127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c5313-44cb-43d9-a36d-edd08f7da3d2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:37.537709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eea995-8c5c-4e17-9d08-7d0de4a97d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-15eea995-8c5c-4e17-9d08-7d0de4a97d7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:37.542359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:37.543815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:37.544996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 181/361] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:37.549944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eea995-8c5c-4e17-9d08-7d0de4a97d7c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.589384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34fc63-da35-476c-94e9-4a43b567c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:37.589944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fc63-da35-476c-94e9-4a43b567c57a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.590230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fc63-da35-476c-94e9-4a43b567c57a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.590501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34fc63-da35-476c-94e9-4a43b567c57a None admin] PATH_INFO: `/v3/users/1817810e396040b68c6fd137a982c915` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.592439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34fc63-da35-476c-94e9-4a43b567c57a None admin] RBAC: Authorizing `identity:get_user(user_id=1817810e396040b68c6fd137a982c915)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:37.594006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34fc63-da35-476c-94e9-4a43b567c57a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:37.595937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 181/362] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/users/1817810e396040b68c6fd137a982c915 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:37.596451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34fc63-da35-476c-94e9-4a43b567c57a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.672928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:37.703475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eea995-8c5c-4e17-9d08-7d0de4a97d7c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:37.723636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:37.733964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34fc63-da35-476c-94e9-4a43b567c57a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:37.751182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a221adc-3864-4fd0-9a47-1218c863c6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:37.751485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221adc-3864-4fd0-9a47-1218c863c6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.751734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221adc-3864-4fd0-9a47-1218c863c6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.753375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221adc-3864-4fd0-9a47-1218c863c6a4 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.755011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a221adc-3864-4fd0-9a47-1218c863c6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:37.756994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a221adc-3864-4fd0-9a47-1218c863c6a4 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:37.758559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 182/363] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:37.759336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a221adc-3864-4fd0-9a47-1218c863c6a4 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.794368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:37.795962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.795962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.796150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.796800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] RBAC: Adding query filter params (group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=1a563089af444e2c9c4d6f29feb1630b) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:37.797147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:37.798620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:37.805668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 182/364] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/role_assignments?group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=d278ed91749c4adf9b130d08698e7933 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:37.806517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.927324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a221adc-3864-4fd0-9a47-1218c863c6a4 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:37.962531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19352ecf-a985-4de4-8c6a-f695d1401a11 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:37.972400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776130-3ed2-4dfb-b6d5-d0980498f3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:37.973203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776130-3ed2-4dfb-b6d5-d0980498f3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:37.973490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776130-3ed2-4dfb-b6d5-d0980498f3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:37.973772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776130-3ed2-4dfb-b6d5-d0980498f3a4 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:37.975212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1776130-3ed2-4dfb-b6d5-d0980498f3a4 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:37.976612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1776130-3ed2-4dfb-b6d5-d0980498f3a4 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:37.978555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 183/365] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:37.979203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776130-3ed2-4dfb-b6d5-d0980498f3a4 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:37.996587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:38.016344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:38.017062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:38.026316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:38.026316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:38.026316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:38.026316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:38.026316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:38.035914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 183/366] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:38.036674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:38.052212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:38.113078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776130-3ed2-4dfb-b6d5-d0980498f3a4 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:38.150843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:38.151449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:38.151725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:38.152634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:38.153407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] RBAC: Adding query filter params (role.id=e9faf0d531a54b68be17731e1203edf3, user.id=1817810e396040b68c6fd137a982c915, scope.system=all) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:38.153708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:38.155156 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:38.159623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d179d-3492-4833-8526-cbb47d87c90d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:38.171183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 184/367] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Sep 5 12:11:37 2022] GET /identity/v3/role_assignments?user.id=1817810e396040b68c6fd137a982c915&scope.system=all&role.id=e9faf0d531a54b68be17731e1203edf3 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:38.172108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:38.216550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18701-cfe0-4d9e-a769-b5e5342d3ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:38.218230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18701-cfe0-4d9e-a769-b5e5342d3ccd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:38.219052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18701-cfe0-4d9e-a769-b5e5342d3ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:38.219532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b18701-cfe0-4d9e-a769-b5e5342d3ccd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:38.236699 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b18701-cfe0-4d9e-a769-b5e5342d3ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d1b18701-cfe0-4d9e-a769-b5e5342d3ccd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:38.243874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:38.244857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:38.245767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:38.248629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 184/368] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:38.250063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18701-cfe0-4d9e-a769-b5e5342d3ccd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:38.309885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:38.334888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45be9-0684-48cf-a11b-f27c9f07aeb6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:38.352069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:38.379687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af8f98-da35-4c7f-8684-62692eb7cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:38.380337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af8f98-da35-4c7f-8684-62692eb7cee6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:38.380616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af8f98-da35-4c7f-8684-62692eb7cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:38.380890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af8f98-da35-4c7f-8684-62692eb7cee6 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:38.382182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af8f98-da35-4c7f-8684-62692eb7cee6 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:38.383645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af8f98-da35-4c7f-8684-62692eb7cee6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:38.385952 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 185/369] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:38 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:38.389015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af8f98-da35-4c7f-8684-62692eb7cee6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:38.391675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b18701-cfe0-4d9e-a769-b5e5342d3ccd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:38.451437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:38.452433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:38.453078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:38.453546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:38.454490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] RBAC: Adding query filter params (group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=1a563089af444e2c9c4d6f29feb1630b) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:38.455010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:38.456648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:38.463674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 185/370] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:38 2022] GET /identity/v3/role_assignments?group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:38.465414 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:38.518524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af8f98-da35-4c7f-8684-62692eb7cee6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:38.560592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0920-062b-475b-873a-e8e59cea2d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:38.562158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0920-062b-475b-873a-e8e59cea2d8b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:38.562667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0920-062b-475b-873a-e8e59cea2d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:38.563141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0920-062b-475b-873a-e8e59cea2d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:38.605261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bf700-25d6-4f36-b7a6-095f1660fae7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:38.626290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:38.647219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:38.669124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:38.669754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:38.670013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:38.670284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:38.670965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:38.671441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:38.672810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:38.682800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 186/371] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:38.689586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:38.689831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b0920-062b-475b-873a-e8e59cea2d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:38.692811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b0920-062b-475b-873a-e8e59cea2d8b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:38.831295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 186/372] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:38.831295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0920-062b-475b-873a-e8e59cea2d8b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:38.901464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558f946-0e68-48b8-891e-2b9f41ee7c3b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:38.951604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:38.952241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:38.952526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:38.952803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:38.953614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] RBAC: Adding query filter params (group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=f1abcea21ac844edaa06b198155110b4) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:38.953962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:38.957207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:38.964185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 187/373] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:38 2022] GET /identity/v3/role_assignments?group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:38.969168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:38.976413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:39.010866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0920-062b-475b-873a-e8e59cea2d8b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:39.105307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:39.107454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966f520-146b-45c3-b147-0c0a1966d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:39.107637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f520-146b-45c3-b147-0c0a1966d252 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:39.107763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f520-146b-45c3-b147-0c0a1966d252 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:39.108088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f520-146b-45c3-b147-0c0a1966d252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:39.243939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327da8d5-1d25-4972-a7eb-9bf8605b0dd2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:39.246202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966f520-146b-45c3-b147-0c0a1966d252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:39.247706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966f520-146b-45c3-b147-0c0a1966d252 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:39.310976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9691e-052d-495f-81e7-8148d00c0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:39.311628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9691e-052d-495f-81e7-8148d00c0edb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:39.311916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9691e-052d-495f-81e7-8148d00c0edb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:39.312188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9691e-052d-495f-81e7-8148d00c0edb None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:39.313632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9691e-052d-495f-81e7-8148d00c0edb None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:39.315089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9691e-052d-495f-81e7-8148d00c0edb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:39.321312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 188/374] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:38 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:39.322232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9691e-052d-495f-81e7-8148d00c0edb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:39.400763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:39.424985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 187/375] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:39.433184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966f520-146b-45c3-b147-0c0a1966d252 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:39.494740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9691e-052d-495f-81e7-8148d00c0edb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:39.496294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:39.535659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df96f5-2771-49db-9e94-6f08c7c63df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:39.536305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df96f5-2771-49db-9e94-6f08c7c63df6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:39.536585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df96f5-2771-49db-9e94-6f08c7c63df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:39.536857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df96f5-2771-49db-9e94-6f08c7c63df6 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:39.538140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df96f5-2771-49db-9e94-6f08c7c63df6 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:39.539575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df96f5-2771-49db-9e94-6f08c7c63df6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:39.541725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 189/376] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:39 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:39.554288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df96f5-2771-49db-9e94-6f08c7c63df6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:39.595310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966f520-146b-45c3-b147-0c0a1966d252 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:39.632098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165acf37-2c73-4ed9-b426-78751938cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:39.633146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acf37-2c73-4ed9-b426-78751938cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:39.633679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acf37-2c73-4ed9-b426-78751938cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:39.634148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165acf37-2c73-4ed9-b426-78751938cdc4 None admin] PATH_INFO: `/v3/projects/a729dadde8474df3811deb87cd30d71e` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:39.637786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165acf37-2c73-4ed9-b426-78751938cdc4 None admin] RBAC: Authorizing `identity:get_project(project_id=a729dadde8474df3811deb87cd30d71e)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:39.639508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165acf37-2c73-4ed9-b426-78751938cdc4 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:39.641799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 188/377] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:39 2022] GET /identity/v3/projects/a729dadde8474df3811deb87cd30d71e => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:39.654062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165acf37-2c73-4ed9-b426-78751938cdc4 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:39.675954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df96f5-2771-49db-9e94-6f08c7c63df6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:39.713682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:39.715898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:39.716229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:39.716502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:39.717281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] RBAC: Adding query filter params (group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=f1abcea21ac844edaa06b198155110b4) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:39.717588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:39.719893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:39.735375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 190/378] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:39 2022] GET /identity/v3/role_assignments?group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=d278ed91749c4adf9b130d08698e7933 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:39.755028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:39.844481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165acf37-2c73-4ed9-b426-78751938cdc4 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:39.903852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bea88-576f-4578-8ba9-b4be58f5f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:39.904655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bea88-576f-4578-8ba9-b4be58f5f95a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:39.904877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bea88-576f-4578-8ba9-b4be58f5f95a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:39.905264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bea88-576f-4578-8ba9-b4be58f5f95a None admin] PATH_INFO: `/v3/groups/08dadb2c8f9e436686a508d672c44484` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:39.912049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bea88-576f-4578-8ba9-b4be58f5f95a None admin] RBAC: Authorizing `identity:get_group(group_id=08dadb2c8f9e436686a508d672c44484)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:39.913565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bea88-576f-4578-8ba9-b4be58f5f95a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:39.915307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 189/379] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:39 2022] GET /identity/v3/groups/08dadb2c8f9e436686a508d672c44484 => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:39.921213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:39.961608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:40.034884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e9059-3923-42c2-840c-817ee43f71f0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:40.084187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749905cd-6e55-49ab-b963-940ed0f44d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:40.084811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749905cd-6e55-49ab-b963-940ed0f44d39 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.085117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749905cd-6e55-49ab-b963-940ed0f44d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.085410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749905cd-6e55-49ab-b963-940ed0f44d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.086128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749905cd-6e55-49ab-b963-940ed0f44d39 None admin] RBAC: Adding query filter params (group.id=08dadb2c8f9e436686a508d672c44484, role.id=41491b52194f43e2902307fb86036726, scope.project.id=a729dadde8474df3811deb87cd30d71e) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:40.086451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749905cd-6e55-49ab-b963-940ed0f44d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:40.088184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749905cd-6e55-49ab-b963-940ed0f44d39 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:40.101495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 191/380] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:39 2022] GET /identity/v3/role_assignments?group.id=08dadb2c8f9e436686a508d672c44484&scope.project.id=a729dadde8474df3811deb87cd30d71e&role.id=41491b52194f43e2902307fb86036726 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:40.221644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a13a2-9ee4-4f94-b394-e27e131979a1 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.221834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a13a2-9ee4-4f94-b394-e27e131979a1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.222154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a13a2-9ee4-4f94-b394-e27e131979a1 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.223773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 190/381] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:40.231018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760e2b-5bfb-4ad3-8dc7-a9556b0628c7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.231344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760e2b-5bfb-4ad3-8dc7-a9556b0628c7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.231564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760e2b-5bfb-4ad3-8dc7-a9556b0628c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.258191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-21760e2b-5bfb-4ad3-8dc7-a9556b0628c7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:40.259616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-21760e2b-5bfb-4ad3-8dc7-a9556b0628c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:40.344575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 192/382] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:40.644146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a13a2-9ee4-4f94-b394-e27e131979a1 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:40.723266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949057-9055-4bc5-9272-39a2019b546d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.723845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949057-9055-4bc5-9272-39a2019b546d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.723948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab949057-9055-4bc5-9272-39a2019b546d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.729522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 193/383] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:40.738091 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2c376-b0fb-463a-bca4-fa42f1b9178c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.738373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2c376-b0fb-463a-bca4-fa42f1b9178c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.738654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2c376-b0fb-463a-bca4-fa42f1b9178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.786148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-dbc2c376-b0fb-463a-bca4-fa42f1b9178c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:40.787376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dbc2c376-b0fb-463a-bca4-fa42f1b9178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:40.813633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a13a2-9ee4-4f94-b394-e27e131979a1 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:40.836154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:40.840246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:40.872976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01de29-d543-44e1-ae61-386f4143bd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:40.872976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01de29-d543-44e1-ae61-386f4143bd79 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.872976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01de29-d543-44e1-ae61-386f4143bd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.872976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01de29-d543-44e1-ae61-386f4143bd79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.883178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01de29-d543-44e1-ae61-386f4143bd79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-7e01de29-d543-44e1-ae61-386f4143bd79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:40.888580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:40.889589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:40.890445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:40.893860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 191/384] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:40.901573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01de29-d543-44e1-ae61-386f4143bd79 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:40.966370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 194/385] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:41.034319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01de29-d543-44e1-ae61-386f4143bd79 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:41.078034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:41.078762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:41.079041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:41.079460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:41.080199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:41.080503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:41.082896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:41.094513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 192/386] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:41.100557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2c376-b0fb-463a-bca4-fa42f1b9178c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:41.230612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2c376-b0fb-463a-bca4-fa42f1b9178c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:41.281792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ff022-931c-483a-a695-cf814b2664ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:41.282466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ff022-931c-483a-a695-cf814b2664ad None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:41.282752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ff022-931c-483a-a695-cf814b2664ad None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:41.283031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ff022-931c-483a-a695-cf814b2664ad None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:41.284366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ff022-931c-483a-a695-cf814b2664ad None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:41.285860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ff022-931c-483a-a695-cf814b2664ad None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:41.287835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 195/387] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:41 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:41.294523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:41.380247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:41.390864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ff022-931c-483a-a695-cf814b2664ad None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:41.457372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:41.519791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2761a-7039-4ea0-800b-c2d52f839ee4 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:41.563358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ff022-931c-483a-a695-cf814b2664ad None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:41.566657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0fc9f-e6d9-4ad8-954e-06b2de9cff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:41.567324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0fc9f-e6d9-4ad8-954e-06b2de9cff11 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:41.567616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0fc9f-e6d9-4ad8-954e-06b2de9cff11 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:41.567896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0fc9f-e6d9-4ad8-954e-06b2de9cff11 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:41.569112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0fc9f-e6d9-4ad8-954e-06b2de9cff11 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:41.570578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0fc9f-e6d9-4ad8-954e-06b2de9cff11 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:41.573174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 193/388] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:41 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:41.575022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc662-6496-48d6-be82-11c074f4b8af None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:41.575730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc662-6496-48d6-be82-11c074f4b8af None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:41.576014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbc662-6496-48d6-be82-11c074f4b8af None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:41.577597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 194/389] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:41.582330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbc662-6496-48d6-be82-11c074f4b8af None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:41.608473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87724a-b692-4bdf-a492-259cb5d5709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:41.609425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87724a-b692-4bdf-a492-259cb5d5709b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:41.609711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87724a-b692-4bdf-a492-259cb5d5709b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:41.609983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87724a-b692-4bdf-a492-259cb5d5709b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:41.624195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87724a-b692-4bdf-a492-259cb5d5709b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4e87724a-b692-4bdf-a492-259cb5d5709b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:41.629663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:41.630926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:41.631924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 196/390] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:41.633353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac8620-e527-470b-bced-2cc18aac37f2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:41.633353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac8620-e527-470b-bced-2cc18aac37f2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:41.633601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac8620-e527-470b-bced-2cc18aac37f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:41.657360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f5ac8620-e527-470b-bced-2cc18aac37f2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:41.658737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f5ac8620-e527-470b-bced-2cc18aac37f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:41.700421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbc662-6496-48d6-be82-11c074f4b8af None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:41.702289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:41.753040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 197/391] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:41.753040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac8620-e527-470b-bced-2cc18aac37f2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:41.760770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a023f-7654-4738-815b-9c3e2e0c2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:41.762708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a023f-7654-4738-815b-9c3e2e0c2a9a None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:41.763151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a023f-7654-4738-815b-9c3e2e0c2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:41.763580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a023f-7654-4738-815b-9c3e2e0c2a9a None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7/roles/d278ed91749c4adf9b130d08698e7933` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:41.767479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a023f-7654-4738-815b-9c3e2e0c2a9a None admin] RBAC: Authorizing `identity:create_grant(project_id=1a563089af444e2c9c4d6f29feb1630b, group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role_id=d278ed91749c4adf9b130d08698e7933)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:41.769691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a023f-7654-4738-815b-9c3e2e0c2a9a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:41.771318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:41.827503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 195/392] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Sep 5 12:11:41 2022] PUT /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7/roles/d278ed91749c4adf9b130d08698e7933 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:41.877746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac8620-e527-470b-bced-2cc18aac37f2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:41.918175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:41.918807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:41.919333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:41.919676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:41.920444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:41.920822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:41.922349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:41.935080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 198/393] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:41.941175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a023f-7654-4738-815b-9c3e2e0c2a9a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:42.117711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a023f-7654-4738-815b-9c3e2e0c2a9a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:42.142741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:42.168636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb908f-0653-4715-8483-764885060da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:42.169562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb908f-0653-4715-8483-764885060da3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.170111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb908f-0653-4715-8483-764885060da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.170539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb908f-0653-4715-8483-764885060da3 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.171850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb908f-0653-4715-8483-764885060da3 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:42.173560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb908f-0653-4715-8483-764885060da3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:42.176016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 196/394] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:41 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:42.181656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb908f-0653-4715-8483-764885060da3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:42.225266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:42.238482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:42.263241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b66ad-49fc-476e-8eb2-c7f9e45ed9f1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:42.320298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb908f-0653-4715-8483-764885060da3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:42.325265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedccb49-211c-4054-816b-a4f45ec6a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:42.325489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedccb49-211c-4054-816b-a4f45ec6a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.325782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedccb49-211c-4054-816b-a4f45ec6a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.326050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedccb49-211c-4054-816b-a4f45ec6a6b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.338864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedccb49-211c-4054-816b-a4f45ec6a6b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-bedccb49-211c-4054-816b-a4f45ec6a6b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:42.345661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:42.346720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:42.347532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:42.350677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 199/395] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:42.357174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedccb49-211c-4054-816b-a4f45ec6a6b7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:42.404912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06e989-c561-404c-b682-d0776de08621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:42.405573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e989-c561-404c-b682-d0776de08621 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.405855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e989-c561-404c-b682-d0776de08621 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.406614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e989-c561-404c-b682-d0776de08621 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.407601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06e989-c561-404c-b682-d0776de08621 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:42.409316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06e989-c561-404c-b682-d0776de08621 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:42.418149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 197/396] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:42 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:42.424009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06e989-c561-404c-b682-d0776de08621 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:42.510694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedccb49-211c-4054-816b-a4f45ec6a6b7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:42.555046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219249ce-84b9-430d-a5cd-fbb52ac701f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:42.555046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219249ce-84b9-430d-a5cd-fbb52ac701f3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.555046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219249ce-84b9-430d-a5cd-fbb52ac701f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.555427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219249ce-84b9-430d-a5cd-fbb52ac701f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.556192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219249ce-84b9-430d-a5cd-fbb52ac701f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:42.556499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219249ce-84b9-430d-a5cd-fbb52ac701f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:42.558618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219249ce-84b9-430d-a5cd-fbb52ac701f3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:42.567143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:42.572425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 200/397] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:42.574599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:42.574993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac4528-bba1-42e3-a8e4-651d155f8e88 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.576132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac4528-bba1-42e3-a8e4-651d155f8e88 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.576600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac4528-bba1-42e3-a8e4-651d155f8e88 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.578537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 201/398] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:42.579071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06e989-c561-404c-b682-d0776de08621 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:42.582647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470aa60-cf23-4aab-ad21-43d45dd81960 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.582647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470aa60-cf23-4aab-ad21-43d45dd81960 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.582647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470aa60-cf23-4aab-ad21-43d45dd81960 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.582902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 202/399] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:42.583532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470aa60-cf23-4aab-ad21-43d45dd81960 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:42.618447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5343a-8d35-415c-851f-65429c49bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:42.622144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5343a-8d35-415c-851f-65429c49bd26 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.622144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5343a-8d35-415c-851f-65429c49bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.622144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5343a-8d35-415c-851f-65429c49bd26 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.622510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5343a-8d35-415c-851f-65429c49bd26 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a563089af444e2c9c4d6f29feb1630b, group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:42.624007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5343a-8d35-415c-851f-65429c49bd26 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:42.674566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 198/400] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Sep 5 12:11:42 2022] PUT /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:42.676591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa3f0-25c0-44ad-a9d8-267fe6eaf397 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.678835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa3f0-25c0-44ad-a9d8-267fe6eaf397 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.679345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa3f0-25c0-44ad-a9d8-267fe6eaf397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.711382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-15faa3f0-25c0-44ad-a9d8-267fe6eaf397 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:42.712627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-15faa3f0-25c0-44ad-a9d8-267fe6eaf397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:42.724142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470aa60-cf23-4aab-ad21-43d45dd81960 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:42.768926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c46817-0480-4b20-921a-5e32088dc5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:42.770367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c46817-0480-4b20-921a-5e32088dc5eb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.770966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c46817-0480-4b20-921a-5e32088dc5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.771415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c46817-0480-4b20-921a-5e32088dc5eb None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.772942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c46817-0480-4b20-921a-5e32088dc5eb None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:42.774758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c46817-0480-4b20-921a-5e32088dc5eb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:42.777696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 203/401] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:42 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:42.779106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ed9b-2c2b-4571-9b68-84534dc82334 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.779891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ed9b-2c2b-4571-9b68-84534dc82334 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.780345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04ed9b-2c2b-4571-9b68-84534dc82334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.795728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 199/402] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:42.796480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faa3f0-25c0-44ad-a9d8-267fe6eaf397 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:42.809016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3b04ed9b-2c2b-4571-9b68-84534dc82334 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:42.809016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3b04ed9b-2c2b-4571-9b68-84534dc82334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:42.894906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:42.908588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faa3f0-25c0-44ad-a9d8-267fe6eaf397 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:42.913662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:42.919535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 204/403] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:42.959509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890f2e-4ace-416c-895e-7d828f16a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:42.960550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890f2e-4ace-416c-895e-7d828f16a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.961038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890f2e-4ace-416c-895e-7d828f16a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.961535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2890f2e-4ace-416c-895e-7d828f16a8f5 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.965325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2890f2e-4ace-416c-895e-7d828f16a8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:42.965325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2890f2e-4ace-416c-895e-7d828f16a8f5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:42.966912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 200/404] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:42 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:42.972562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ed9b-2c2b-4571-9b68-84534dc82334 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.084967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04ed9b-2c2b-4571-9b68-84534dc82334 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:43.121659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890f2e-4ace-416c-895e-7d828f16a8f5 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.124671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afdede-72a5-4a3a-a04d-4e5332167af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:43.125838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afdede-72a5-4a3a-a04d-4e5332167af8 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:43.126301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afdede-72a5-4a3a-a04d-4e5332167af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:43.126772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afdede-72a5-4a3a-a04d-4e5332167af8 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.128934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afdede-72a5-4a3a-a04d-4e5332167af8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1abcea21ac844edaa06b198155110b4, group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:43.131726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afdede-72a5-4a3a-a04d-4e5332167af8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:43.230795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 205/405] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Sep 5 12:11:42 2022] PUT /identity/v3/projects/f1abcea21ac844edaa06b198155110b4/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:11:43.250073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2890f2e-4ace-416c-895e-7d828f16a8f5 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:43.257531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afdede-72a5-4a3a-a04d-4e5332167af8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.292861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3bc6-23b5-48aa-9f55-4380d61c44ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:43.293670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3bc6-23b5-48aa-9f55-4380d61c44ea None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:43.293959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3bc6-23b5-48aa-9f55-4380d61c44ea None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:43.294245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3bc6-23b5-48aa-9f55-4380d61c44ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.311347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd3bc6-23b5-48aa-9f55-4380d61c44ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-c4fd3bc6-23b5-48aa-9f55-4380d61c44ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:43.316662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:43.317645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:43.318464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 201/406] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:43.326353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3bc6-23b5-48aa-9f55-4380d61c44ea None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.348265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:43.384564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:43.434022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afdede-72a5-4a3a-a04d-4e5332167af8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:43.461212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3bc6-23b5-48aa-9f55-4380d61c44ea None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:43.483637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebd70d-905a-4814-8db6-06f04b37e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:43.484514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebd70d-905a-4814-8db6-06f04b37e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:43.484803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebd70d-905a-4814-8db6-06f04b37e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:43.485151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebd70d-905a-4814-8db6-06f04b37e1b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.498660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebd70d-905a-4814-8db6-06f04b37e1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:43.503148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:43.503853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-abebd70d-905a-4814-8db6-06f04b37e1b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:43.504071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:43.504918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:43.505751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:43.506432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:43.506432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.506432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:43.506627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 206/407] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:43.509201 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:43.510630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:43.512250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebd70d-905a-4814-8db6-06f04b37e1b4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.537459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 202/408] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:43.538420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.631817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebd70d-905a-4814-8db6-06f04b37e1b4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:43.665356 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:43.679657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:43.680353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:43.680856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:43.681161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.681928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:43.682236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:43.684172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:43.693211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:43.699544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 207/409] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:43.706482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.742699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61c362-4811-43bd-bd79-cfdcb53d0299 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:43.810538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33a5e-53ae-4643-93e5-db8179835c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:43.811582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33a5e-53ae-4643-93e5-db8179835c08 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:43.812083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33a5e-53ae-4643-93e5-db8179835c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:43.812694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d33a5e-53ae-4643-93e5-db8179835c08 None admin] PATH_INFO: `/v3/groups/08dadb2c8f9e436686a508d672c44484` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.821059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d33a5e-53ae-4643-93e5-db8179835c08 None admin] RBAC: Authorizing `identity:get_group(group_id=08dadb2c8f9e436686a508d672c44484)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:43.822521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d33a5e-53ae-4643-93e5-db8179835c08 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:43.825488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 203/410] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/groups/08dadb2c8f9e436686a508d672c44484 => generated 229 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:43.838067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33a5e-53ae-4643-93e5-db8179835c08 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.888502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff075b0-f7ad-4a04-bb01-6262b5eed910 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:43.926836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579e3cc-b6c8-4665-b731-c4f774f2a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:43.927835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e3cc-b6c8-4665-b731-c4f774f2a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:43.928339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e3cc-b6c8-4665-b731-c4f774f2a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:43.928806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e3cc-b6c8-4665-b731-c4f774f2a8c5 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.930177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579e3cc-b6c8-4665-b731-c4f774f2a8c5 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:43.931988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579e3cc-b6c8-4665-b731-c4f774f2a8c5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:43.934646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 208/411] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:43.945379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579e3cc-b6c8-4665-b731-c4f774f2a8c5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:44.021413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:44.051843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d33a5e-53ae-4643-93e5-db8179835c08 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:44.069428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579e3cc-b6c8-4665-b731-c4f774f2a8c5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:44.113765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9107697-0e43-483a-8098-b1d109d313bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:44.114767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107697-0e43-483a-8098-b1d109d313bf None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:44.115227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107697-0e43-483a-8098-b1d109d313bf None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:44.115780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107697-0e43-483a-8098-b1d109d313bf None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:44.117145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9107697-0e43-483a-8098-b1d109d313bf None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:44.118759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9107697-0e43-483a-8098-b1d109d313bf None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:44.120933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 209/412] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:44.127074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9107697-0e43-483a-8098-b1d109d313bf None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:44.149096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03003-561f-4230-b1d0-d66ce2bbbdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:44.150300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03003-561f-4230-b1d0-d66ce2bbbdec None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:44.150757 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03003-561f-4230-b1d0-d66ce2bbbdec None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:44.151228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e03003-561f-4230-b1d0-d66ce2bbbdec None admin] PATH_INFO: `/v3/projects/a729dadde8474df3811deb87cd30d71e` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:44.153225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e03003-561f-4230-b1d0-d66ce2bbbdec None admin] RBAC: Authorizing `identity:get_project(project_id=a729dadde8474df3811deb87cd30d71e)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:44.155200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e03003-561f-4230-b1d0-d66ce2bbbdec None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:44.157528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 204/413] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/projects/a729dadde8474df3811deb87cd30d71e => generated 344 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:44.166539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03003-561f-4230-b1d0-d66ce2bbbdec None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:44.187046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:44.265679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9107697-0e43-483a-8098-b1d109d313bf None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:44.284144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:44.284642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e03003-561f-4230-b1d0-d66ce2bbbdec None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:44.307542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555865d-f184-418c-8f82-97b2031f56bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:44.308369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555865d-f184-418c-8f82-97b2031f56bd None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:44.308747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555865d-f184-418c-8f82-97b2031f56bd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:44.309200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555865d-f184-418c-8f82-97b2031f56bd None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7/roles/d278ed91749c4adf9b130d08698e7933` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:44.311789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555865d-f184-418c-8f82-97b2031f56bd None admin] RBAC: Authorizing `identity:create_grant(project_id=f1abcea21ac844edaa06b198155110b4, group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role_id=d278ed91749c4adf9b130d08698e7933)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:44.313502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555865d-f184-418c-8f82-97b2031f56bd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:44.322639 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34a94d-68ab-44a4-93bb-7fa298e0f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:44.323326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34a94d-68ab-44a4-93bb-7fa298e0f398 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:44.324130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34a94d-68ab-44a4-93bb-7fa298e0f398 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:44.324398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34a94d-68ab-44a4-93bb-7fa298e0f398 None admin] PATH_INFO: `/v3/projects/a729dadde8474df3811deb87cd30d71e/groups/08dadb2c8f9e436686a508d672c44484/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:44.326637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34a94d-68ab-44a4-93bb-7fa298e0f398 None admin] RBAC: Authorizing `identity:create_grant(project_id=a729dadde8474df3811deb87cd30d71e, group_id=08dadb2c8f9e436686a508d672c44484, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:44.328282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34a94d-68ab-44a4-93bb-7fa298e0f398 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:44.421582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 210/414] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Sep 5 12:11:44 2022] PUT /identity/v3/projects/f1abcea21ac844edaa06b198155110b4/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7/roles/d278ed91749c4adf9b130d08698e7933 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:44.421582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95af34-45c4-4477-97cd-475bd780dbde None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:44.421582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95af34-45c4-4477-97cd-475bd780dbde None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:44.421582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95af34-45c4-4477-97cd-475bd780dbde None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:44.422622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 211/415] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:44.427670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027ce5-b3c6-4966-bdab-1a4cbdb1c912 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:44.427997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027ce5-b3c6-4966-bdab-1a4cbdb1c912 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:44.428219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69027ce5-b3c6-4966-bdab-1a4cbdb1c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:44.436542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 205/416] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Sep 5 12:11:44 2022] PUT /identity/v3/projects/a729dadde8474df3811deb87cd30d71e/groups/08dadb2c8f9e436686a508d672c44484/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:11:44.451235 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-69027ce5-b3c6-4966-bdab-1a4cbdb1c912 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:44.452784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-69027ce5-b3c6-4966-bdab-1a4cbdb1c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:44.549355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 212/417] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:44.829694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34a94d-68ab-44a4-93bb-7fa298e0f398 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:44.950286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:44.986673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34a94d-68ab-44a4-93bb-7fa298e0f398 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:45.042668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355cb7d-d23f-4188-82d9-da21b6eef866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:45.043318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355cb7d-d23f-4188-82d9-da21b6eef866 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.043598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355cb7d-d23f-4188-82d9-da21b6eef866 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.043867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355cb7d-d23f-4188-82d9-da21b6eef866 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.056901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355cb7d-d23f-4188-82d9-da21b6eef866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-5355cb7d-d23f-4188-82d9-da21b6eef866 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:45.062997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:45.063896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:45.064709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:45.066876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 206/418] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:45.072841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69027ce5-b3c6-4966-bdab-1a4cbdb1c912 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:45.232334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69027ce5-b3c6-4966-bdab-1a4cbdb1c912 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:45.240446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:45.279162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:45.279787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.280139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.280411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.281115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:45.281417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:45.282776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:45.297303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 213/419] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:45.300261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07383-c6ea-486d-a1a5-478f11dfdd45 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.300541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07383-c6ea-486d-a1a5-478f11dfdd45 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.300812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b07383-c6ea-486d-a1a5-478f11dfdd45 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.302431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 207/420] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:45.303495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:45.307613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf4e2-a3e6-4437-bd3f-75e69c85706d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.307953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf4e2-a3e6-4437-bd3f-75e69c85706d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.308229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baf4e2-a3e6-4437-bd3f-75e69c85706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.326511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-00baf4e2-a3e6-4437-bd3f-75e69c85706d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:45.327702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-00baf4e2-a3e6-4437-bd3f-75e69c85706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:45.404799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 208/421] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:45.469333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ff728-4fec-4d4d-8d44-05a550806400 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:45.505803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4a634-6728-485c-bf53-a20983e4f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:45.506314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a634-6728-485c-bf53-a20983e4f228 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.506652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a634-6728-485c-bf53-a20983e4f228 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.506930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4a634-6728-485c-bf53-a20983e4f228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.531772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d8145-f6f0-41a9-af6c-cf3afefeed53 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.532107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d8145-f6f0-41a9-af6c-cf3afefeed53 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.532309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d8145-f6f0-41a9-af6c-cf3afefeed53 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.538142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 209/422] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:11:45.540048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0383-dafa-499e-922a-35856a49caba None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.540333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0383-dafa-499e-922a-35856a49caba None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.540609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0383-dafa-499e-922a-35856a49caba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.562795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:45.564487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-51df0383-dafa-499e-922a-35856a49caba None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:45.565742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-51df0383-dafa-499e-922a-35856a49caba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:45.633983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4a634-6728-485c-bf53-a20983e4f228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:45.635816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4a634-6728-485c-bf53-a20983e4f228 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:45.638232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:45.655359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 210/423] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:45.764553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 214/424] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:45.769769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0383-dafa-499e-922a-35856a49caba None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:45.915819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0383-dafa-499e-922a-35856a49caba None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:45.949473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4a634-6728-485c-bf53-a20983e4f228 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:45.969857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c9152-b151-48fe-bda8-3e7544401309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:45.970505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c9152-b151-48fe-bda8-3e7544401309 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.970782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c9152-b151-48fe-bda8-3e7544401309 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.971052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c9152-b151-48fe-bda8-3e7544401309 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.974864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c9152-b151-48fe-bda8-3e7544401309 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:45.976322 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c9152-b151-48fe-bda8-3e7544401309 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:45.977978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 211/425] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:45 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:45.984611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c9152-b151-48fe-bda8-3e7544401309 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.047240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.056805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.086579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4a634-6728-485c-bf53-a20983e4f228 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.098760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c9152-b151-48fe-bda8-3e7544401309 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.124504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3fec9-3f87-41ea-a0e2-39e4d4872f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.125466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fec9-3f87-41ea-a0e2-39e4d4872f9a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.125822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fec9-3f87-41ea-a0e2-39e4d4872f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.126238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fec9-3f87-41ea-a0e2-39e4d4872f9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.136871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7de84-9354-43ac-ab0f-90c9e28d0ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.137791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7de84-9354-43ac-ab0f-90c9e28d0ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.138240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7de84-9354-43ac-ab0f-90c9e28d0ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.138697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7de84-9354-43ac-ab0f-90c9e28d0ef2 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.140001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7de84-9354-43ac-ab0f-90c9e28d0ef2 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:46.140106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3fec9-3f87-41ea-a0e2-39e4d4872f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:46.141757 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7de84-9354-43ac-ab0f-90c9e28d0ef2 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:46.143790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 212/426] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:45 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:46.144804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7de84-9354-43ac-ab0f-90c9e28d0ef2 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-67a3fec9-3f87-41ea-a0e2-39e4d4872f9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:46.145998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:46.146871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:46.147719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 215/427] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:46.153578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3fec9-3f87-41ea-a0e2-39e4d4872f9a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.254889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7de84-9354-43ac-ab0f-90c9e28d0ef2 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.264107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3fec9-3f87-41ea-a0e2-39e4d4872f9a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.286643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.293539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65712d-91e8-45ab-9b45-df36f83f4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.293844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.294587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65712d-91e8-45ab-9b45-df36f83f4695 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.298027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65712d-91e8-45ab-9b45-df36f83f4695 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.298027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65712d-91e8-45ab-9b45-df36f83f4695 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.302577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.303184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.303521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.303801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.304529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] RBAC: Adding query filter params (group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=1a563089af444e2c9c4d6f29feb1630b) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:46.304837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:46.306494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:46.307937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65712d-91e8-45ab-9b45-df36f83f4695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ad65712d-91e8-45ab-9b45-df36f83f4695 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:46.313232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:46.314114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:11:46.315007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:46.315601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 216/428] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/role_assignments?group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=d278ed91749c4adf9b130d08698e7933 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:46.315601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.322258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 213/429] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:46.324175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65712d-91e8-45ab-9b45-df36f83f4695 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.432930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df017155-78ec-4617-92f7-eeed19f55f8f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.434837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65712d-91e8-45ab-9b45-df36f83f4695 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.472232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.473017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.473308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.473580 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.474189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.474317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:46.474586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:46.475330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.475805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.475967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:46.476409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.477290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:46.477796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:46.479356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:46.485793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 217/430] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:46.489313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 214/431] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:46.492615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.501830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.556547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.587029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.606181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82db1e-8ce3-45ab-9d04-e3c528c2c30d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.649969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6acd7-b00e-4960-908a-03f4ff3a2650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.650848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6acd7-b00e-4960-908a-03f4ff3a2650 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.651194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6acd7-b00e-4960-908a-03f4ff3a2650 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.651495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6acd7-b00e-4960-908a-03f4ff3a2650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.656316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002951ec-523a-4aac-8135-89e3269bcee7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.700464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da187d1-05fb-41dc-b9be-4ff9a302578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.701551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da187d1-05fb-41dc-b9be-4ff9a302578c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.702027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da187d1-05fb-41dc-b9be-4ff9a302578c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.702424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da187d1-05fb-41dc-b9be-4ff9a302578c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.770566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6acd7-b00e-4960-908a-03f4ff3a2650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:46.772050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6acd7-b00e-4960-908a-03f4ff3a2650 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:46.791226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da187d1-05fb-41dc-b9be-4ff9a302578c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:46.793286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da187d1-05fb-41dc-b9be-4ff9a302578c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:46.835367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.862787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.892810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 218/432] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:46.902491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6acd7-b00e-4960-908a-03f4ff3a2650 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.926357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 215/433] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:11:46.927802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed307d6c-bd96-4c8d-a3d3-d2ae1047963a None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.928090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed307d6c-bd96-4c8d-a3d3-d2ae1047963a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.928365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed307d6c-bd96-4c8d-a3d3-d2ae1047963a None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.929641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 216/434] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:46.930639 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e777-0e0c-47b2-b3da-2bfe46d069b9 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.931229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e777-0e0c-47b2-b3da-2bfe46d069b9 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.931534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e777-0e0c-47b2-b3da-2bfe46d069b9 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.933356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 217/435] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:46.936840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6e777-0e0c-47b2-b3da-2bfe46d069b9 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.015213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6acd7-b00e-4960-908a-03f4ff3a2650 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.035781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6e777-0e0c-47b2-b3da-2bfe46d069b9 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.050392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ac12d-e22c-4ea7-b91a-0420b6851a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.051024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ac12d-e22c-4ea7-b91a-0420b6851a40 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.051357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ac12d-e22c-4ea7-b91a-0420b6851a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.051577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ac12d-e22c-4ea7-b91a-0420b6851a40 None admin] PATH_INFO: `/v3/projects/1a563089af444e2c9c4d6f29feb1630b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.052706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ac12d-e22c-4ea7-b91a-0420b6851a40 None admin] RBAC: Authorizing `identity:get_project(project_id=1a563089af444e2c9c4d6f29feb1630b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:47.054190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ac12d-e22c-4ea7-b91a-0420b6851a40 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:47.055804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 219/436] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/projects/1a563089af444e2c9c4d6f29feb1630b => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:47.056907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc571-e98f-4edc-b84a-3e00e767a478 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.057222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc571-e98f-4edc-b84a-3e00e767a478 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.057497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bc571-e98f-4edc-b84a-3e00e767a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.073730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608d67d-79c1-443e-9630-d963f151c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.074355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608d67d-79c1-443e-9630-d963f151c482 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.074633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608d67d-79c1-443e-9630-d963f151c482 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.074902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608d67d-79c1-443e-9630-d963f151c482 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.075396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-632bc571-e98f-4edc-b84a-3e00e767a478 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:47.076168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608d67d-79c1-443e-9630-d963f151c482 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:47.076596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-632bc571-e98f-4edc-b84a-3e00e767a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:47.077668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608d67d-79c1-443e-9630-d963f151c482 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:47.083755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 218/437] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:47.083755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f4e8a-c353-4b96-be7b-0ab2eed861eb None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.083755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f4e8a-c353-4b96-be7b-0ab2eed861eb None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.083755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f4e8a-c353-4b96-be7b-0ab2eed861eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.093472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:47.098606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-9f2f4e8a-c353-4b96-be7b-0ab2eed861eb None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:47.099800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9f2f4e8a-c353-4b96-be7b-0ab2eed861eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:47.114066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:47.143997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 220/438] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:47.144834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bc571-e98f-4edc-b84a-3e00e767a478 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.169556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 219/439] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:47.170401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f4e8a-c353-4b96-be7b-0ab2eed861eb None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.278578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f4e8a-c353-4b96-be7b-0ab2eed861eb None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.283690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bc571-e98f-4edc-b84a-3e00e767a478 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.315814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbe6bd-8ad0-4a7c-a46a-45e74c7da7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.316441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbe6bd-8ad0-4a7c-a46a-45e74c7da7de None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.316716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbe6bd-8ad0-4a7c-a46a-45e74c7da7de None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.317087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbe6bd-8ad0-4a7c-a46a-45e74c7da7de None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.318160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbe6bd-8ad0-4a7c-a46a-45e74c7da7de None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:47.319593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbe6bd-8ad0-4a7c-a46a-45e74c7da7de None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:47.325932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 220/440] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:47.327110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbe6bd-8ad0-4a7c-a46a-45e74c7da7de None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.336011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7988-abf4-4788-9bac-74ea6987f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.336646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7988-abf4-4788-9bac-74ea6987f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.336922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7988-abf4-4788-9bac-74ea6987f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.337322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed7988-abf4-4788-9bac-74ea6987f0f1 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.338476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed7988-abf4-4788-9bac-74ea6987f0f1 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:47.339940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed7988-abf4-4788-9bac-74ea6987f0f1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:47.341709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 221/441] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:47.347535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7988-abf4-4788-9bac-74ea6987f0f1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.351855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:47.372168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:47.451874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbe6bd-8ad0-4a7c-a46a-45e74c7da7de None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.457616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed7988-abf4-4788-9bac-74ea6987f0f1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.486070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.486672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.486951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.487220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.487938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] RBAC: Adding query filter params (group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=f1abcea21ac844edaa06b198155110b4) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:47.488242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:47.489696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:47.492877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.493505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.493790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.494068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.494791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] RBAC: Adding query filter params (group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role.id=b63ccf0f2ba84473bd7b8ef888c937af, scope.project.id=1a563089af444e2c9c4d6f29feb1630b) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:47.495100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:47.495679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 221/442] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/role_assignments?group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:47.496469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.496700 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:47.512990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 222/443] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/role_assignments?group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7&scope.project.id=1a563089af444e2c9c4d6f29feb1630b&role.id=b63ccf0f2ba84473bd7b8ef888c937af => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:47.512990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.607575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:47.615401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:47.630097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f868df-acd7-4956-98c9-066fda72c5ec None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.633718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d7b0e-3bbe-42b1-8611-c7ee451f1002 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.677095 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdc11c-a945-4117-b5f3-8717da98be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.678157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc11c-a945-4117-b5f3-8717da98be63 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.678690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc11c-a945-4117-b5f3-8717da98be63 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.679111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdc11c-a945-4117-b5f3-8717da98be63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.679976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff27b9-fa40-41ac-a8c2-5503c6fc530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.680614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff27b9-fa40-41ac-a8c2-5503c6fc530d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.680895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff27b9-fa40-41ac-a8c2-5503c6fc530d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.681214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff27b9-fa40-41ac-a8c2-5503c6fc530d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.693224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdc11c-a945-4117-b5f3-8717da98be63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:47.697666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff27b9-fa40-41ac-a8c2-5503c6fc530d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-94bdc11c-a945-4117-b5f3-8717da98be63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:47.699301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:47.700185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:11:47.701031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:47.702934 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 222/444] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-c4ff27b9-fa40-41ac-a8c2-5503c6fc530d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:47.704093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:47.705020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:47.705845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 223/445] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:47.709336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdc11c-a945-4117-b5f3-8717da98be63 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.710936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff27b9-fa40-41ac-a8c2-5503c6fc530d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.823132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdc11c-a945-4117-b5f3-8717da98be63 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.831903 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff27b9-fa40-41ac-a8c2-5503c6fc530d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:47.874693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.875244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.875526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.875804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.876519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:47.876784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:47.878248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:47.878899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:47.879916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:47.883607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:47.883607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:47.883607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:47.883607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:47.884658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:47.888641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 223/446] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:47.894378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.899808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 224/447] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:47.904725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:47.907932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:47.919514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:48.020328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58018860-7b91-42bb-8f3c-d4fb94caa206 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:48.029548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3ac0f-d8b9-4eb2-8aaf-12015e088895 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:48.062042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fd5af-b6ee-42a5-aa04-34f2a56d7d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:48.063413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fd5af-b6ee-42a5-aa04-34f2a56d7d0d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.063413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fd5af-b6ee-42a5-aa04-34f2a56d7d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.063413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fd5af-b6ee-42a5-aa04-34f2a56d7d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.072336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf31f94-c288-453f-b5ae-41a49050a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:48.072982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf31f94-c288-453f-b5ae-41a49050a61f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.073305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf31f94-c288-453f-b5ae-41a49050a61f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.074054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf31f94-c288-453f-b5ae-41a49050a61f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.146045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fd5af-b6ee-42a5-aa04-34f2a56d7d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:48.146045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fd5af-b6ee-42a5-aa04-34f2a56d7d0d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:48.149368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:48.163820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf31f94-c288-453f-b5ae-41a49050a61f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:48.165407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf31f94-c288-453f-b5ae-41a49050a61f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:48.174225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:48.273777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 224/448] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:11:48.280092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fd5af-b6ee-42a5-aa04-34f2a56d7d0d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:48.285515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 225/449] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:11:48.291461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf31f94-c288-453f-b5ae-41a49050a61f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:48.378480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fd5af-b6ee-42a5-aa04-34f2a56d7d0d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:48.380789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:48.387698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf31f94-c288-453f-b5ae-41a49050a61f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:48.396543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:48.414384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78857982-b1f1-4c10-8976-dfdd6ef2f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:48.415013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78857982-b1f1-4c10-8976-dfdd6ef2f5dd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.415291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78857982-b1f1-4c10-8976-dfdd6ef2f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.415558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78857982-b1f1-4c10-8976-dfdd6ef2f5dd None admin] PATH_INFO: `/v3/projects/a729dadde8474df3811deb87cd30d71e` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.416679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78857982-b1f1-4c10-8976-dfdd6ef2f5dd None admin] RBAC: Authorizing `identity:get_project(project_id=a729dadde8474df3811deb87cd30d71e)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:48.418712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78857982-b1f1-4c10-8976-dfdd6ef2f5dd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:48.420299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 225/450] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:48 2022] GET /identity/v3/projects/a729dadde8474df3811deb87cd30d71e => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:48.424482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b081b-ff09-4ef3-a6a8-f745c92e9382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:48.425219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b081b-ff09-4ef3-a6a8-f745c92e9382 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.425504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b081b-ff09-4ef3-a6a8-f745c92e9382 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.425738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78857982-b1f1-4c10-8976-dfdd6ef2f5dd None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:48.425849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b081b-ff09-4ef3-a6a8-f745c92e9382 None admin] PATH_INFO: `/v3/projects/f1abcea21ac844edaa06b198155110b4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.426966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b081b-ff09-4ef3-a6a8-f745c92e9382 None admin] RBAC: Authorizing `identity:get_project(project_id=f1abcea21ac844edaa06b198155110b4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:48.428401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b081b-ff09-4ef3-a6a8-f745c92e9382 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:48.430044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 226/451] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:11:48 2022] GET /identity/v3/projects/f1abcea21ac844edaa06b198155110b4 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:48.435297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b081b-ff09-4ef3-a6a8-f745c92e9382 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:48.524194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78857982-b1f1-4c10-8976-dfdd6ef2f5dd None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:48.537432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b081b-ff09-4ef3-a6a8-f745c92e9382 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:48.557619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c25f4-ab77-45b0-ba3f-d09acc8baf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:48.558285 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c25f4-ab77-45b0-ba3f-d09acc8baf40 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.558562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c25f4-ab77-45b0-ba3f-d09acc8baf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.558831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c25f4-ab77-45b0-ba3f-d09acc8baf40 None admin] PATH_INFO: `/v3/groups/08dadb2c8f9e436686a508d672c44484` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.559936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c25f4-ab77-45b0-ba3f-d09acc8baf40 None admin] RBAC: Authorizing `identity:get_group(group_id=08dadb2c8f9e436686a508d672c44484)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:48.561388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c25f4-ab77-45b0-ba3f-d09acc8baf40 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:48.562930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 226/452] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:48 2022] GET /identity/v3/groups/08dadb2c8f9e436686a508d672c44484 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:48.568610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c25f4-ab77-45b0-ba3f-d09acc8baf40 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:48.570338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c476ed-585d-4d9c-b846-d4fcaa1ec237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:48.570906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c476ed-585d-4d9c-b846-d4fcaa1ec237 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.571186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c476ed-585d-4d9c-b846-d4fcaa1ec237 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.571454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c476ed-585d-4d9c-b846-d4fcaa1ec237 None admin] PATH_INFO: `/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.572559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c476ed-585d-4d9c-b846-d4fcaa1ec237 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb76a59d7a54e67aaea4b8f0fec2cb7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:48.574588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c476ed-585d-4d9c-b846-d4fcaa1ec237 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:48.576258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 227/453] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Sep 5 12:11:48 2022] GET /identity/v3/groups/dfb76a59d7a54e67aaea4b8f0fec2cb7 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:48.581794 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c476ed-585d-4d9c-b846-d4fcaa1ec237 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:48.614346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:48.624840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:48.672271 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c25f4-ab77-45b0-ba3f-d09acc8baf40 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:48.684908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c476ed-585d-4d9c-b846-d4fcaa1ec237 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:48.707738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c7d4c-a72f-4d99-bba3-3dd8732a3934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:48.708343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c7d4c-a72f-4d99-bba3-3dd8732a3934 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.708633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c7d4c-a72f-4d99-bba3-3dd8732a3934 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.708909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c7d4c-a72f-4d99-bba3-3dd8732a3934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.709664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c7d4c-a72f-4d99-bba3-3dd8732a3934 None admin] RBAC: Adding query filter params (group.id=08dadb2c8f9e436686a508d672c44484, role.id=41491b52194f43e2902307fb86036726, scope.project.id=a729dadde8474df3811deb87cd30d71e) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:48.709980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c7d4c-a72f-4d99-bba3-3dd8732a3934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:48.711527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c7d4c-a72f-4d99-bba3-3dd8732a3934 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:48.717794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 227/454] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:48 2022] GET /identity/v3/role_assignments?group.id=08dadb2c8f9e436686a508d672c44484&scope.project.id=a729dadde8474df3811deb87cd30d71e&role.id=41491b52194f43e2902307fb86036726 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:48.719816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee59f-ee77-4321-b6f9-1da954c4a388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:48.720423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee59f-ee77-4321-b6f9-1da954c4a388 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.720702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee59f-ee77-4321-b6f9-1da954c4a388 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.721067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee59f-ee77-4321-b6f9-1da954c4a388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.721758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deee59f-ee77-4321-b6f9-1da954c4a388 None admin] RBAC: Adding query filter params (group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7, role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=f1abcea21ac844edaa06b198155110b4) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:48.722067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deee59f-ee77-4321-b6f9-1da954c4a388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:48.723654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deee59f-ee77-4321-b6f9-1da954c4a388 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:48.733021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 228/455] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Sep 5 12:11:48 2022] GET /identity/v3/role_assignments?group.id=dfb76a59d7a54e67aaea4b8f0fec2cb7&scope.project.id=f1abcea21ac844edaa06b198155110b4&role.id=d278ed91749c4adf9b130d08698e7933 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:51.328359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6ba4-5bf6-4f63-842f-bcf7f9739ac6 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:51.329433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6ba4-5bf6-4f63-842f-bcf7f9739ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:51.329951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6ba4-5bf6-4f63-842f-bcf7f9739ac6 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:51.331795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 228/456] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:51.337817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d356-e91f-4e5c-ab09-b16bd9670b07 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:51.338738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d356-e91f-4e5c-ab09-b16bd9670b07 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:51.339775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d356-e91f-4e5c-ab09-b16bd9670b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:51.359516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1008d356-e91f-4e5c-ab09-b16bd9670b07 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:51.361111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1008d356-e91f-4e5c-ab09-b16bd9670b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:51.456073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 229/457] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:51.474803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579935-2601-4206-a1f5-2d03c12a6ec7 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:51.475414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579935-2601-4206-a1f5-2d03c12a6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:51.475893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579935-2601-4206-a1f5-2d03c12a6ec7 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:51.477486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 229/458] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:51.483302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30d71-b208-48e1-bcaf-b34f24dd9e16 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:51.483875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30d71-b208-48e1-bcaf-b34f24dd9e16 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:51.484362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30d71-b208-48e1-bcaf-b34f24dd9e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:51.508556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cdb30d71-b208-48e1-bcaf-b34f24dd9e16 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:51.510227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cdb30d71-b208-48e1-bcaf-b34f24dd9e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:51.545300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:51.596397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 230/459] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:51.789245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56a99-8e21-4e27-8e57-2439f9c8d537 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:51.789615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56a99-8e21-4e27-8e57-2439f9c8d537 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:51.789807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56a99-8e21-4e27-8e57-2439f9c8d537 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:51.791487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 230/460] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:51.798014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9bed-3806-4bcf-a254-1634a8568531 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:51.798626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9bed-3806-4bcf-a254-1634a8568531 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:51.799134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9bed-3806-4bcf-a254-1634a8568531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:51.819398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-42fc9bed-3806-4bcf-a254-1634a8568531 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:51.821024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-42fc9bed-3806-4bcf-a254-1634a8568531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:51.918902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba56a99-8e21-4e27-8e57-2439f9c8d537 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:51.933154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 231/461] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:11:52.004796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9bed-3806-4bcf-a254-1634a8568531 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.149145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba56a99-8e21-4e27-8e57-2439f9c8d537 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.153726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:52.190729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62579a27-0f28-427f-b646-06610a4e9094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.191723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62579a27-0f28-427f-b646-06610a4e9094 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.192228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62579a27-0f28-427f-b646-06610a4e9094 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.192716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62579a27-0f28-427f-b646-06610a4e9094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.196637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:52.205739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62579a27-0f28-427f-b646-06610a4e9094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.207344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62579a27-0f28-427f-b646-06610a4e9094 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.215680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9bed-3806-4bcf-a254-1634a8568531 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-62579a27-0f28-427f-b646-06610a4e9094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:52.224430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:52.225532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:52.226404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:52.226404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:52.226404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:52.226404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 231/462] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:52.227363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db2bd-a3a3-43c9-bccb-67f2e5679900 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.230876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db2bd-a3a3-43c9-bccb-67f2e5679900 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.230876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db2bd-a3a3-43c9-bccb-67f2e5679900 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.230876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 232/463] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:52.231212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83db2bd-a3a3-43c9-bccb-67f2e5679900 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.255322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.255963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.256313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.256694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.267587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.269145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:52.288214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:52.289283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:52.290834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:52.290834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:52.290834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:52.290834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 232/464] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:52.290834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.349319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83db2bd-a3a3-43c9-bccb-67f2e5679900 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.386254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87a667-cbd8-4dac-85c4-3e0735f5aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.386983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a667-cbd8-4dac-85c4-3e0735f5aa74 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.387331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a667-cbd8-4dac-85c4-3e0735f5aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.387776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a667-cbd8-4dac-85c4-3e0735f5aa74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.399001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87a667-cbd8-4dac-85c4-3e0735f5aa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.400642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87a667-cbd8-4dac-85c4-3e0735f5aa74 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.410637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1eb18-2ffd-4c06-aecb-128d02790dfd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-2e87a667-cbd8-4dac-85c4-3e0735f5aa74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:52.420318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:52.427171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:52.428035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:52.428035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:52.428035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:52.428035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 233/465] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:52.428035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1f27-4328-4a00-9d6a-b0cfed79a9d9 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.428035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1f27-4328-4a00-9d6a-b0cfed79a9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.428035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1f27-4328-4a00-9d6a-b0cfed79a9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.443213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-124b1f27-4328-4a00-9d6a-b0cfed79a9d9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:52.444715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-124b1f27-4328-4a00-9d6a-b0cfed79a9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:52.447453 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:52.458962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.459573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.459855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.473472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.473472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:52.473472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.473472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.483034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 233/466] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:52.483034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.493703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:52.521735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 234/467] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:52.522689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1f27-4328-4a00-9d6a-b0cfed79a9d9 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.591856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e557d7-608e-4dc5-857a-57c6cd568d2a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.628645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.629614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.630072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.630552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.631451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:52.631955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.633688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.636523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1f27-4328-4a00-9d6a-b0cfed79a9d9 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.646540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 234/468] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:52.647674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.674578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.675238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.675516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.675786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.676574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:52.676878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.678483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.690660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:52.702232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 235/469] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:52.702232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.723552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:52.760209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5ea53-cac8-4b03-8aaa-27394a07c81f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.797851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e2cc5-1b7b-40c8-8d8f-0a494ab56033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.798827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e2cc5-1b7b-40c8-8d8f-0a494ab56033 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.799776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e2cc5-1b7b-40c8-8d8f-0a494ab56033 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.800253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e2cc5-1b7b-40c8-8d8f-0a494ab56033 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.801413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e2cc5-1b7b-40c8-8d8f-0a494ab56033 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.803877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e2cc5-1b7b-40c8-8d8f-0a494ab56033 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.811835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112edb38-c260-4eda-815c-9cdce4358109 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.849671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fddfc-5043-4a21-91ff-7d94a9de3612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.850407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fddfc-5043-4a21-91ff-7d94a9de3612 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.850694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fddfc-5043-4a21-91ff-7d94a9de3612 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.850965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fddfc-5043-4a21-91ff-7d94a9de3612 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.851613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fddfc-5043-4a21-91ff-7d94a9de3612 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.853092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fddfc-5043-4a21-91ff-7d94a9de3612 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.912466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 235/470] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:52 2022] POST /identity/v3/users => generated 246 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:52.913336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e2cc5-1b7b-40c8-8d8f-0a494ab56033 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.988251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 236/471] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:52 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:52.990506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fddfc-5043-4a21-91ff-7d94a9de3612 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:53.083030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:53.086948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e2cc5-1b7b-40c8-8d8f-0a494ab56033 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:53.133001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:53.144106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a14ef-3122-49b9-9410-f95515d92913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:53.144800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a14ef-3122-49b9-9410-f95515d92913 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:53.151754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a14ef-3122-49b9-9410-f95515d92913 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:53.151754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a14ef-3122-49b9-9410-f95515d92913 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:53.151754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a14ef-3122-49b9-9410-f95515d92913 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:53.151754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a14ef-3122-49b9-9410-f95515d92913 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:53.158474 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fddfc-5043-4a21-91ff-7d94a9de3612 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:53.200618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:53.201688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:53.202171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:53.202645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:53.222286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:53.225081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:53.233862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 236/472] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:52 2022] POST /identity/v3/users => generated 248 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:53.234973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588a70-e174-4787-a38e-45aad87ddc5a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:53.235314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588a70-e174-4787-a38e-45aad87ddc5a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:53.235891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588a70-e174-4787-a38e-45aad87ddc5a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:53.237630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 237/473] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:53.243798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30f12-9761-438d-bd5a-9876b8139c3e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:53.244072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30f12-9761-438d-bd5a-9876b8139c3e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:53.244288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a30f12-9761-438d-bd5a-9876b8139c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:53.251723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:53.252996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:53.253908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:53.253908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:53.253908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:53.253908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 237/474] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:53.267283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:53.279459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-33a30f12-9761-438d-bd5a-9876b8139c3e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:53.279459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-33a30f12-9761-438d-bd5a-9876b8139c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:53.364014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 238/475] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:53.420294 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9c439-6047-40f4-821d-50b927bedc1f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:53.428808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:53.471715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:53.472340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:53.472630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:53.472900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:53.473594 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:53.473902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:53.475311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:53.488870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 238/476] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:53.494809 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30f12-9761-438d-bd5a-9876b8139c3e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:53.612107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a30f12-9761-438d-bd5a-9876b8139c3e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:53.625498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:53.651810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41fd4-53f8-4b16-92a9-4ad380458052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:53.652438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41fd4-53f8-4b16-92a9-4ad380458052 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:53.652722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41fd4-53f8-4b16-92a9-4ad380458052 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:53.653020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41fd4-53f8-4b16-92a9-4ad380458052 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:53.653733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c41fd4-53f8-4b16-92a9-4ad380458052 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:53.655271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c41fd4-53f8-4b16-92a9-4ad380458052 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:53.706256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:53.758017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 239/477] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:53 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:53.835431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4313-cbbb-46e2-80fa-5171585e13fb None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:53.879296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:53.879927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:53.880211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:53.880486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:53.881213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:53.882607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:53.918104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.sql.core [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 12:11:53.918104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 12:11:53.918104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [parameters: {'id': '24f50106463b4de6aab596ab94831709', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 12:11:53.918104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81685) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application result.read() Sep 05 12:11:53.939109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return ref.to_dict() Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:11:53.940040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application yield resource Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise self.value Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application session.commit() Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 12:11:53.941002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.session.flush() Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application compat.raise_( Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 12:11:53.941886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:11:53.942787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application result.read() Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:11:53.943616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [parameters: {'id': '24f50106463b4de6aab596ab94831709', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:53.944424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 12:11:53.947159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:53.949763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 239/478] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Sep 5 12:11:53 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:53.955831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41fd4-53f8-4b16-92a9-4ad380458052 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:54.071622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41fd4-53f8-4b16-92a9-4ad380458052 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:54.124795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d310d-4442-4081-b46f-7ca8eba58bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:54.125482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d310d-4442-4081-b46f-7ca8eba58bdc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:54.125766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d310d-4442-4081-b46f-7ca8eba58bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:54.126046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d310d-4442-4081-b46f-7ca8eba58bdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:54.137901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d310d-4442-4081-b46f-7ca8eba58bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1f1d310d-4442-4081-b46f-7ca8eba58bdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:54.143359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:54.145301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:54.146347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 240/479] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:11:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:54.153574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:54.188968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:54.266267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706f41f-a286-4c57-b3e6-ef593234be89 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:54.327404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce92da5-9352-41eb-8e4c-f92705aee952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:54.327938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce92da5-9352-41eb-8e4c-f92705aee952 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:54.328215 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce92da5-9352-41eb-8e4c-f92705aee952 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:54.328486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce92da5-9352-41eb-8e4c-f92705aee952 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:54.329195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce92da5-9352-41eb-8e4c-f92705aee952 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:54.329497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce92da5-9352-41eb-8e4c-f92705aee952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:54.331049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce92da5-9352-41eb-8e4c-f92705aee952 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:54.345442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 240/480] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:11:55.340229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c251-56f2-4fb3-93d2-1f876f073822 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:55.341015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c251-56f2-4fb3-93d2-1f876f073822 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:55.341015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c251-56f2-4fb3-93d2-1f876f073822 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:55.342461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 241/481] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:55.347941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af501-0839-439d-9470-4d5f87077e63 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:55.348412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af501-0839-439d-9470-4d5f87077e63 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:55.348499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af501-0839-439d-9470-4d5f87077e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:55.367140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-bd5af501-0839-439d-9470-4d5f87077e63 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:55.368359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bd5af501-0839-439d-9470-4d5f87077e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:55.466339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 241/482] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:55.501048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072a78-2862-48b1-9ee4-413358ee31ab None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:55.501387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072a78-2862-48b1-9ee4-413358ee31ab None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:55.501604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072a78-2862-48b1-9ee4-413358ee31ab None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:55.502998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 242/483] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:55.508309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13aa2e-c61f-4986-bba5-b3e664f28a2b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:55.508752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13aa2e-c61f-4986-bba5-b3e664f28a2b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:55.509189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13aa2e-c61f-4986-bba5-b3e664f28a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:55.537979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2d13aa2e-c61f-4986-bba5-b3e664f28a2b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:55.539429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2d13aa2e-c61f-4986-bba5-b3e664f28a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:55.575140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:55.644972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 242/484] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:55.751909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072a78-2862-48b1-9ee4-413358ee31ab None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:55.789213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:55.893839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072a78-2862-48b1-9ee4-413358ee31ab None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:55.941931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d683d6-bc2c-4a5e-8319-d47a5b240ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:55.942779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d683d6-bc2c-4a5e-8319-d47a5b240ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:55.943198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d683d6-bc2c-4a5e-8319-d47a5b240ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:55.943625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d683d6-bc2c-4a5e-8319-d47a5b240ad9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:55.959798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d683d6-bc2c-4a5e-8319-d47a5b240ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-41d683d6-bc2c-4a5e-8319-d47a5b240ad9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:55.965633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:55.966676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:11:55.967652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:55.970041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 243/485] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:55.980313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13aa2e-c61f-4986-bba5-b3e664f28a2b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.050356 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b29423-2942-4b17-b49d-ed802ecbfc4d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.050949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b29423-2942-4b17-b49d-ed802ecbfc4d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.051434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b29423-2942-4b17-b49d-ed802ecbfc4d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.053090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 244/486] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:56.067926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddfd27-9993-4102-b0ac-206c7d803392 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.068557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddfd27-9993-4102-b0ac-206c7d803392 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.069105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddfd27-9993-4102-b0ac-206c7d803392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.090877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0bddfd27-9993-4102-b0ac-206c7d803392 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:56.092253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0bddfd27-9993-4102-b0ac-206c7d803392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:56.117284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13aa2e-c61f-4986-bba5-b3e664f28a2b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:56.154385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:56.155028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.155357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.155629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.156345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:56.156702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:56.158109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:56.167445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 243/487] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:56.168220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.172658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 245/488] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:56.173804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddfd27-9993-4102-b0ac-206c7d803392 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.192906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:56.193782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:56.340069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddfd27-9993-4102-b0ac-206c7d803392 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:56.344980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481acdd-e0bb-47b0-ae98-16e7cb30bc0b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:56.379491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391968b-c369-4248-80ca-071e142e6c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:56.380293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391968b-c369-4248-80ca-071e142e6c15 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.380576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391968b-c369-4248-80ca-071e142e6c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.381203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391968b-c369-4248-80ca-071e142e6c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.389815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c736eda-6b8c-41e7-b490-87550c6567df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:56.390565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736eda-6b8c-41e7-b490-87550c6567df None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.391417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736eda-6b8c-41e7-b490-87550c6567df None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.391788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736eda-6b8c-41e7-b490-87550c6567df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.392902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391968b-c369-4248-80ca-071e142e6c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:56.394569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391968b-c369-4248-80ca-071e142e6c15 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:56.405014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c736eda-6b8c-41e7-b490-87550c6567df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-0c736eda-6b8c-41e7-b490-87550c6567df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:56.411395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:56.413211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:11:56.415316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0391968b-c369-4248-80ca-071e142e6c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:56.416912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:56.421083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:56.421946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:56.421946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:56.421946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:56.421946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 246/489] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:11:56.422156 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 244/490] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:56.422222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1099ed-34a8-42e2-91ba-ec32c165ca90 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.422222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1099ed-34a8-42e2-91ba-ec32c165ca90 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.422222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1099ed-34a8-42e2-91ba-ec32c165ca90 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.422222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 247/491] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:56.422707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b222-5785-4814-9416-537b48fdb734 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.423206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b222-5785-4814-9416-537b48fdb734 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.423481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b222-5785-4814-9416-537b48fdb734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.426173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1099ed-34a8-42e2-91ba-ec32c165ca90 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.447366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f2c1b222-5785-4814-9416-537b48fdb734 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:56.448579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f2c1b222-5785-4814-9416-537b48fdb734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:56.505558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:56.531959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 245/492] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:56.532626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1b222-5785-4814-9416-537b48fdb734 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.537702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:56.566431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1099ed-34a8-42e2-91ba-ec32c165ca90 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:56.614219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:56.615166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.615481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.615761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.616761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:56.617132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:56.618707 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:56.640980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 248/493] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:56.640980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.680029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1b222-5785-4814-9416-537b48fdb734 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:56.720133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:56.720673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.720970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.721266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.722559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:56.722559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:56.723792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:56.737652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 246/494] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:56.737652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.759406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f328a-f2d5-434a-ad02-102666501964 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:56.787761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:56.798756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72370c-730c-4760-aa0e-f4aa44f2bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:56.801615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72370c-730c-4760-aa0e-f4aa44f2bbee None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.801615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72370c-730c-4760-aa0e-f4aa44f2bbee None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.801615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72370c-730c-4760-aa0e-f4aa44f2bbee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.809946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:56.812148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72370c-730c-4760-aa0e-f4aa44f2bbee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5d72370c-730c-4760-aa0e-f4aa44f2bbee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:56.817150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:56.818053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:56.818989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 249/495] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:56.819653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72370c-730c-4760-aa0e-f4aa44f2bbee None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.852598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3348ba-7e7a-40e0-ade2-88f4c8af2ced None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:56.892457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:56.893123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.893410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.893679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.902711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:56.904181 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:11:56.921253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:56.922218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:56.923118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 247/496] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:56.923724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:56.938329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72370c-730c-4760-aa0e-f4aa44f2bbee None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:56.971555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449950-c07d-4432-802d-25747430a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:56.972100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449950-c07d-4432-802d-25747430a00b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:56.972377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449950-c07d-4432-802d-25747430a00b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:56.972648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449950-c07d-4432-802d-25747430a00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:56.983282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28449950-c07d-4432-802d-25747430a00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:56.984735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28449950-c07d-4432-802d-25747430a00b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-28449950-c07d-4432-802d-25747430a00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:56.999847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:57.000762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:57.001688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:57.001688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:57.001688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:57.001688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 250/497] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:57.001901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449950-c07d-4432-802d-25747430a00b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.030954 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d2c24-e51b-48ad-8ed6-fe7111ae6576 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.057234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:57.067214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:57.073542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e4f7-b007-49e1-8051-f0f7e8a7a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.074260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e4f7-b007-49e1-8051-f0f7e8a7a87b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.074536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e4f7-b007-49e1-8051-f0f7e8a7a87b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.074803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0e4f7-b007-49e1-8051-f0f7e8a7a87b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.085179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0e4f7-b007-49e1-8051-f0f7e8a7a87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-c3d0e4f7-b007-49e1-8051-f0f7e8a7a87b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:11:57.090801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:57.091913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 248/498] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:57.092765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e4f7-b007-49e1-8051-f0f7e8a7a87b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.129501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449950-c07d-4432-802d-25747430a00b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.164186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709a843-2ecd-42cd-bbc7-98560def870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.164799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a843-2ecd-42cd-bbc7-98560def870c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.165120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a843-2ecd-42cd-bbc7-98560def870c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.165397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709a843-2ecd-42cd-bbc7-98560def870c None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.166060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a843-2ecd-42cd-bbc7-98560def870c None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:57.166366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a843-2ecd-42cd-bbc7-98560def870c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:57.168323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709a843-2ecd-42cd-bbc7-98560def870c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:57.176220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 251/499] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:57.177426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36566b7-6db2-468e-8e06-ed3924b10d8a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.177711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36566b7-6db2-468e-8e06-ed3924b10d8a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.177986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36566b7-6db2-468e-8e06-ed3924b10d8a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.179192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 252/500] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:11:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:57.179886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36566b7-6db2-468e-8e06-ed3924b10d8a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.199219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0e4f7-b007-49e1-8051-f0f7e8a7a87b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.233884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.234436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.234715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.235400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.236127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:57.236433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:57.237938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:57.273244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 249/501] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:57.274082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.282972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36566b7-6db2-468e-8e06-ed3924b10d8a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.284523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:57.316839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.317856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.318334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.318916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.319559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:57.319861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:57.321260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:57.324043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:57.332459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 253/502] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:57.339237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.379121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81b473-54af-4818-b798-00fb8f7db7c7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.418878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72b43d-3872-4414-9cbc-712d01d3e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.419781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b43d-3872-4414-9cbc-712d01d3e9ef None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.420202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b43d-3872-4414-9cbc-712d01d3e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.420616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72b43d-3872-4414-9cbc-712d01d3e9ef None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.421686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b43d-3872-4414-9cbc-712d01d3e9ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:57.422150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b43d-3872-4414-9cbc-712d01d3e9ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:57.424365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d72b43d-3872-4414-9cbc-712d01d3e9ef None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:57.441048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 250/503] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:57.441048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc780b-22c0-4fb2-a69c-d0d8f7381fc4 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.441048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc780b-22c0-4fb2-a69c-d0d8f7381fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.441048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc780b-22c0-4fb2-a69c-d0d8f7381fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.447029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b222b0-0958-4ea9-ac46-c9ff122d5064 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.462196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ffdc780b-22c0-4fb2-a69c-d0d8f7381fc4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:57.463422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ffdc780b-22c0-4fb2-a69c-d0d8f7381fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:57.482334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.482989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.483272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.483545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.494885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:57.496233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:57.510370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:57.512004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:57.513319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:57.513319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:57.513319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:57.513319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 254/504] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:57.517612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.531711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 251/505] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:11:57.532426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc780b-22c0-4fb2-a69c-d0d8f7381fc4 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.535069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:57.575569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:57.625440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35fd87-059b-46ec-8f41-9a952545b637 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.643144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc780b-22c0-4fb2-a69c-d0d8f7381fc4 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.661710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff90b8a-60b2-48e2-bd00-da887dffcaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.662418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff90b8a-60b2-48e2-bd00-da887dffcaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.662767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff90b8a-60b2-48e2-bd00-da887dffcaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.663108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff90b8a-60b2-48e2-bd00-da887dffcaa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.678320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.679049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.679366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.679688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.698848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:57.700450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:11:57.712686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:57.714393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:11:57.715469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:57.718555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 252/506] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:57.718555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.758085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff90b8a-60b2-48e2-bd00-da887dffcaa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:57.759802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff90b8a-60b2-48e2-bd00-da887dffcaa5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:57.791658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:57.837025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:57.844074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff816e6-c960-489c-818f-0c55cf94c26b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:57.879217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:57.879856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.880133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.880403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.887651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 255/507] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:57.888489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff90b8a-60b2-48e2-bd00-da887dffcaa5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.892250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:57.893658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:57.908808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:57.910002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:57.910859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:57.910859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:57.910859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:57.910859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 253/508] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:57.910859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:57.998717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff90b8a-60b2-48e2-bd00-da887dffcaa5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.011555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e1be4-49ea-416e-965f-c6f5dc91f46c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.012012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.032452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.033084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.036836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.036836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.036836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:58.036836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.036836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.046571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.047186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.047484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.047758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.048023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 256/509] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:58.048492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:58.048799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.048894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.050278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.068864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 254/510] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:11:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:58.069812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.079328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.162963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ae0b3-d07c-4a36-be33-970d539684ab None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.191860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ef66-9e8b-42de-8b3d-6b63377c170f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.196718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.197372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.197683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.197999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.208461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.209932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:58.224435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:58.225627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:58.226854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:58.226854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:58.226854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:58.226854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 257/511] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:58.226854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.229807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.231372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.231655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.231935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.242499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.243992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.255134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:58.261035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:58.261985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:58.262848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:58.262848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:58.262848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:58.262848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 255/512] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:58.263088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.321720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.331895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605dd6c-762b-4e6e-ac42-144e36883e76 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.362582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9da88b-351b-4915-9daa-f99f6f6fd532 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.365897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.366505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.366778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.367047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.367686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:58.367990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.369389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.381859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 258/513] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:58.382709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.398993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.399622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.399900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.400427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.408094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.409565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:11:58.421194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:58.422529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 256/514] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:58.423443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.470336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.485162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49801-ade1-47f3-8e6a-fc5616b8a47d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.521151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138df07-7eec-4825-a9b4-957172f259b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.521671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138df07-7eec-4825-a9b4-957172f259b2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.521947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138df07-7eec-4825-a9b4-957172f259b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.522217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138df07-7eec-4825-a9b4-957172f259b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.522305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f034d-2b21-47dd-840d-089a11d9e5a6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.539446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.558085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.558692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.558971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.559237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.559879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:58.560182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.561581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.574237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 257/515] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:58.575165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.590272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138df07-7eec-4825-a9b4-957172f259b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.591748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138df07-7eec-4825-a9b4-957172f259b2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.678601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.681906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5356-558b-4c69-a9f3-3520b7de5948 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.693988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 259/516] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:58.694820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138df07-7eec-4825-a9b4-957172f259b2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.716190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.716797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.717119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.717397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.718047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:58.718353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.719739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.731875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 258/517] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:58.732701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.772314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.799479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138df07-7eec-4825-a9b4-957172f259b2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.835336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a340bd-e2e5-4418-9d78-9c819b3b1a7c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.835566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.836199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.836478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.836749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.845453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.847253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:11:58.860872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:58.861799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 260/518] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:58.862905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.872970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.873672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.873867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.874135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.874870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:58.875175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.876679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.895370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 259/519] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:58.896215 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.920115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.974668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c104742-6b87-4ca7-8dfd-362b3eb03cbf None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.000827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:59.008391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac405882-9f65-4dc0-9e82-73b45ae09c2f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.011269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4f680-7619-4ae1-95ef-81d6b372e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.014279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f680-7619-4ae1-95ef-81d6b372e4e5 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.014279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f680-7619-4ae1-95ef-81d6b372e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.014279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f680-7619-4ae1-95ef-81d6b372e4e5 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.014279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4f680-7619-4ae1-95ef-81d6b372e4e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.014701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4f680-7619-4ae1-95ef-81d6b372e4e5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.044332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.044886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.045194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.045465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.055826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.057394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:11:59.071935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:59.073595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:11:59.074605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:11:59.074605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:11:59.074605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:59.077147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 260/520] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:59.078220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:59.078514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 261/521] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:11:58 2022] POST /identity/v3/users => generated 247 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:11:59.079311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4f680-7619-4ae1-95ef-81d6b372e4e5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:59.200358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0390f4-7eaf-430b-bd2c-38c8620d9064 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.207358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4f680-7619-4ae1-95ef-81d6b372e4e5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.209067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:59.243276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.243995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.244469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.244583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.250393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.250666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.250955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.251237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.251873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.251995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:59.252283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.253514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.253845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:11:59.269513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:59.270632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:59.271575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:11:59.271575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:11:59.271575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:11:59.271575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:11:59.271575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:11:59.271575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:11:59.271575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:11:59.271575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:11:59.273367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 261/522] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:59.274346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:59.287245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:59.300521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 262/523] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:59.301649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:59.398907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e11aad-e0e2-4b70-84ea-1b71bafee39b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.421403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd930b-13d1-4880-8899-62c7112f6401 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.449374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ad8b-4bac-4ccd-a8a8-d934f6b5b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.450564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ad8b-4bac-4ccd-a8a8-d934f6b5b4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.451016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ad8b-4bac-4ccd-a8a8-d934f6b5b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.451435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ad8b-4bac-4ccd-a8a8-d934f6b5b4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.463321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.463965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.464251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.464527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.465216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:59.465552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.466945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.479175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 263/524] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:59.480447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:59.506101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:59.530982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2ad8b-4bac-4ccd-a8a8-d934f6b5b4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.532538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2ad8b-4bac-4ccd-a8a8-d934f6b5b4a6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.543208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:59.591680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2d652-cade-41f9-be67-5fb4524bff16 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.630414 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.631389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.631739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.632090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.632914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:11:59.633261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.634843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.644440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 262/525] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:59.644440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ad8b-4bac-4ccd-a8a8-d934f6b5b4a6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:59.655967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 264/526] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:11:59.656685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:59.755928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ad8b-4bac-4ccd-a8a8-d934f6b5b4a6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.758312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:59.766697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:59.779423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c23dca-2e0f-4885-ade0-f932730b7a53 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.794491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212af635-3590-4d0e-b8a1-6c1a0678cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.795381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212af635-3590-4d0e-b8a1-6c1a0678cf26 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.795822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212af635-3590-4d0e-b8a1-6c1a0678cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.796329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212af635-3590-4d0e-b8a1-6c1a0678cf26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.815297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.815922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.816212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.816494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.823614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.825110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:11:59.838387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:11:59.840003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:11:59.840876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 265/527] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:11:59.841376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:59.880911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212af635-3590-4d0e-b8a1-6c1a0678cf26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:59.882628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212af635-3590-4d0e-b8a1-6c1a0678cf26 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:59.949817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e77a2f-bfcc-41bb-bb7f-1fa0ea4d7f97 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:59.986074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:59.986939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:59.987416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:59.987829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:59.989113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 263/528] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:11:59.989958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212af635-3590-4d0e-b8a1-6c1a0678cf26 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.002392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:00.003261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:00.005919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.007527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:00.022821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:00.023897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:00.024771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:00.024771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:00.024771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:00.031597 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 266/529] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:00.032675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.108822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212af635-3590-4d0e-b8a1-6c1a0678cf26 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:00.146975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:00.147492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:00.147772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:00.148040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:00.148769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=66a29dd8d28f44f0b311d167fd39b4f6) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:00.149127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.150824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.164982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 264/530] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:11:59 2022] GET /identity/v3/role_assignments?user.id=66a29dd8d28f44f0b311d167fd39b4f6&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:00.164982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.165268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ddc0-3d3c-49d9-a5f7-6b526228c872 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:00.248415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:00.249351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:00.249640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:00.250416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:00.251437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:00.251754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.253299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.261853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:00.273032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 267/531] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:00.274206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.313823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0b75b-9604-4ff7-9055-58af4cb3d652 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:00.363949 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:00.364900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:00.365256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:00.365519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:00.369285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:00.379864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.382050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:00.400539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:00.401981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:00.402842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:00.402842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:00.402842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:00.405056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 265/532] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:00.406061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.425476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2f298-d19a-4a13-a95c-0dd77e18055b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:00.460282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:00.460894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:00.461206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:00.461486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:00.462129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:00.462434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.464378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.476755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 268/533] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:00.477753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.514653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e64dc-36d0-4f64-b916-e07fd759bbb7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:00.545369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:00.552887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:00.553664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:00.554049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:00.554419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:00.555312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=2029f59c77de4240a78dba6960735bde) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:00.555721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.557589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.569287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 266/534] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/role_assignments?user.id=2029f59c77de4240a78dba6960735bde&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:00.570464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.585252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eebacd-e7b3-43ed-b529-fd41956c8476 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:00.605702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:00.626577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:00.627188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:00.627468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:00.627736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:00.628384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:00.628685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.630108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.644142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 269/535] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:00.649686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.776699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0092543-11b2-4954-978c-38ec3845dc58 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:00.818625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e16734-4ad7-4b34-adbf-f330e5fef3ff None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:00.858689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:00.859326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:00.859614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:00.859886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:00.867948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:00.869044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:00.869542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:00.870567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:00.870673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.872227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:00.885245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:00.886677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:00.887531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 270/536] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:00.902849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:00.905595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:00.908290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:00.929906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:00.932045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:00.938904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 267/537] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:00.945789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:00.976607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:01.037415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:01.108335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350845e-f0d9-49bc-8b29-9aedfcfbba01 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:01.132603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdc59f-9f8b-4b26-95d6-70dde2c0ed7a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:01.160851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed981de-9a0e-410b-a21a-5ce885ae9ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:01.162035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed981de-9a0e-410b-a21a-5ce885ae9ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:01.162861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed981de-9a0e-410b-a21a-5ce885ae9ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:01.163670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed981de-9a0e-410b-a21a-5ce885ae9ae7 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:01.164787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed981de-9a0e-410b-a21a-5ce885ae9ae7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:01.165326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed981de-9a0e-410b-a21a-5ce885ae9ae7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:01.167644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed981de-9a0e-410b-a21a-5ce885ae9ae7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:01.171063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6886756-3914-4a98-b436-6510d2e26b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:01.171796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6886756-3914-4a98-b436-6510d2e26b28 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:01.172183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6886756-3914-4a98-b436-6510d2e26b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:01.172559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6886756-3914-4a98-b436-6510d2e26b28 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:01.173408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6886756-3914-4a98-b436-6510d2e26b28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:01.173824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6886756-3914-4a98-b436-6510d2e26b28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:01.175381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6886756-3914-4a98-b436-6510d2e26b28 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:01.183346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 271/538] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:01.184809 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a732fc-e60d-4929-847f-799ba7c98a93 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:01.185283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a732fc-e60d-4929-847f-799ba7c98a93 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:01.185703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a732fc-e60d-4929-847f-799ba7c98a93 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:01.187388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 272/539] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:01.189147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a732fc-e60d-4929-847f-799ba7c98a93 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:01.204613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 268/540] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:01.209352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129854c-0c78-4e9a-a381-ea853dada935 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:01.209352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129854c-0c78-4e9a-a381-ea853dada935 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:01.209352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129854c-0c78-4e9a-a381-ea853dada935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:01.227452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b129854c-0c78-4e9a-a381-ea853dada935 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:01.228818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b129854c-0c78-4e9a-a381-ea853dada935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:01.309399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:01.316289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a732fc-e60d-4929-847f-799ba7c98a93 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:01.320707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 269/541] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:01.321905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129854c-0c78-4e9a-a381-ea853dada935 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:01.361497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:01.362405 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:01.362833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:01.363269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:01.365092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=fa7ce8d93f864130a3c079b1aec6b678) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:01.365545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:01.367068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:01.376904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 273/542] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:01 2022] GET /identity/v3/role_assignments?user.id=fa7ce8d93f864130a3c079b1aec6b678&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:01.382691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:01.504357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129854c-0c78-4e9a-a381-ea853dada935 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:01.558254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:01.558928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:01.559157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:01.559391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:01.560180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=77ae8a6fe7ff4190aa3cd8c7f820d15b) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:01.560428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:01.561908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:01.569461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 270/543] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:01 2022] GET /identity/v3/role_assignments?user.id=77ae8a6fe7ff4190aa3cd8c7f820d15b&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:01.622559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:01.740542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a53967-0a95-4e25-be92-afed54a8107c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:01.779372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b020-44ce-441f-9c21-8bb472dcff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:01.780006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b020-44ce-441f-9c21-8bb472dcff2f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:01.780289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b020-44ce-441f-9c21-8bb472dcff2f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:01.780563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016b020-44ce-441f-9c21-8bb472dcff2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:01.791451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016b020-44ce-441f-9c21-8bb472dcff2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8016b020-44ce-441f-9c21-8bb472dcff2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:01.796478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:01.797404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:01.798203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 274/544] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:01.804805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:01.915322 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a220ff-f85c-4505-a748-9a1da11117e0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:01.917089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:01.972914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:01.973569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:01.973904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:01.974184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:01.974868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:01.975172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:01.976569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:01.986146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 271/545] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:01.991990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b020-44ce-441f-9c21-8bb472dcff2f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:02.016911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:02.106744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016b020-44ce-441f-9c21-8bb472dcff2f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:02.142719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:02.143437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:02.143724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:02.143997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:02.156008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:02.157551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:02.175934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:02.177303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:02.178176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:02.178176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:02.178176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:02.178176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 275/546] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:02.190573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:02.314227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e1fee-2069-4b85-9ccf-a33fdb25383e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:02.349920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e63c5f-d7b9-41ef-8757-22018372776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:02.350533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63c5f-d7b9-41ef-8757-22018372776c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:02.351059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63c5f-d7b9-41ef-8757-22018372776c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:02.351059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e63c5f-d7b9-41ef-8757-22018372776c None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:02.351716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e63c5f-d7b9-41ef-8757-22018372776c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:02.352017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e63c5f-d7b9-41ef-8757-22018372776c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:02.353428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e63c5f-d7b9-41ef-8757-22018372776c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:02.366768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 272/547] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:02.374080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:02.438366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e11a-744b-48a7-934d-883b06e6a298 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:02.439003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e11a-744b-48a7-934d-883b06e6a298 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:02.439532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050e11a-744b-48a7-934d-883b06e6a298 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:02.441390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 273/548] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:02.446902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd380-f733-4e9d-9b6d-9f71af5f8baf None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:02.447493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd380-f733-4e9d-9b6d-9f71af5f8baf None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:02.448049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd380-f733-4e9d-9b6d-9f71af5f8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:02.481979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-502cd380-f733-4e9d-9b6d-9f71af5f8baf None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:02.483555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-502cd380-f733-4e9d-9b6d-9f71af5f8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:02.499069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:02.533402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:02.565015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216fa9e-180f-4e28-b353-9a48ac0935d9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:02.606075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:02.607238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:02.607821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:02.608378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:02.617758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:02.620239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:02.641902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:02.643565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:02.644493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 276/549] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:02.648708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:02.663475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 274/550] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:12:02.779179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575af13a-7953-4e4d-988e-2a27947bbe60 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:02.814246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:02.826544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:02.828743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:02.828743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:02.828743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:02.829087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:02.829282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:02.830931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:02.861379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 277/551] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Sep 5 12:12:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:02.866794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cd380-f733-4e9d-9b6d-9f71af5f8baf None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.006173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.014019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cd380-f733-4e9d-9b6d-9f71af5f8baf None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:03.054977 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831f223-58c2-41ac-8803-12c946c605c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:03.055599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f223-58c2-41ac-8803-12c946c605c0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.055882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f223-58c2-41ac-8803-12c946c605c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.056158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831f223-58c2-41ac-8803-12c946c605c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.109150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:03.169946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92d3c8-2a80-4797-b0ed-68ef401f88ce None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:03.170174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831f223-58c2-41ac-8803-12c946c605c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:03.171576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831f223-58c2-41ac-8803-12c946c605c0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:03.204727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a789a9d-2035-4364-bcb9-ad2a420d9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:03.205393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789a9d-2035-4364-bcb9-ad2a420d9e4d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.205672 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789a9d-2035-4364-bcb9-ad2a420d9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.205948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a789a9d-2035-4364-bcb9-ad2a420d9e4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.217606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a789a9d-2035-4364-bcb9-ad2a420d9e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-9a789a9d-2035-4364-bcb9-ad2a420d9e4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:03.222908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:03.224123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:03.225375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 278/552] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:03.231284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80a996-59ea-467b-9e4b-be1bb5b2164e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.231676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80a996-59ea-467b-9e4b-be1bb5b2164e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.231964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80a996-59ea-467b-9e4b-be1bb5b2164e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.233547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 279/553] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:03.234392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80a996-59ea-467b-9e4b-be1bb5b2164e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.297241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 275/554] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:03.298926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db848b7-f9ae-49df-84e7-734d271b743d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.299221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db848b7-f9ae-49df-84e7-734d271b743d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.299493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db848b7-f9ae-49df-84e7-734d271b743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.306663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:03.319781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2db848b7-f9ae-49df-84e7-734d271b743d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:03.326179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2db848b7-f9ae-49df-84e7-734d271b743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:03.366734 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80a996-59ea-467b-9e4b-be1bb5b2164e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:03.378428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:03.405047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 276/555] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:03.405981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db848b7-f9ae-49df-84e7-734d271b743d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.419472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:03.420149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.420438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.420711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.421539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:03.423449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:03.423618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:03.433819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 280/556] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:03.439318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.575541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db848b7-f9ae-49df-84e7-734d271b743d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:03.581427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73447-7572-474a-9ff0-7b2c1778f5cd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:03.591328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:03.613761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:03.614437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.614714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.614993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.627450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:03.628924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:03.646519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:03.649083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:03.652432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:03.652432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:03.652432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:03.652845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:03.652845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.652845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.657610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 277/557] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:03.657765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.657945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.667907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:03.670071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:03.687513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:03.690365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:03.692480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:03.692480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:03.692480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:03.693437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 281/558] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:03.696970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.751125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:03.821477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52febf-5bdf-4ae2-920f-f98a6ec74ac8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:03.839960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb2c3-2006-4aff-ba4a-018623633e7c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:03.863678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:03.864561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.865038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.865491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.866853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:03.867316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:03.868930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:03.890243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:03.890243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:03.890243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:03.890243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:03.890715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:03.890715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:03.890715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:03.891052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 282/559] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:03.893040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.905886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 278/560] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:03.906776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:03.929408 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.018243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.020815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb78e79-c5d0-421e-b3ca-003ebec2d90d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.023834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdbc3f-c4ce-4e82-8db8-a24015a34bd5 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.056117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d6c74-6a90-4d8d-bd1d-b5c3f4f65fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.056748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6c74-6a90-4d8d-bd1d-b5c3f4f65fed None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.057628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6c74-6a90-4d8d-bd1d-b5c3f4f65fed None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.058059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6c74-6a90-4d8d-bd1d-b5c3f4f65fed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.059241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec613ae-64f3-4fb3-a9d8-a9b09047baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.059869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec613ae-64f3-4fb3-a9d8-a9b09047baf4 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.060157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec613ae-64f3-4fb3-a9d8-a9b09047baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.060435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec613ae-64f3-4fb3-a9d8-a9b09047baf4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.067430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec613ae-64f3-4fb3-a9d8-a9b09047baf4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:04.068514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d6c74-6a90-4d8d-bd1d-b5c3f4f65fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:04.068876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec613ae-64f3-4fb3-a9d8-a9b09047baf4 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-fc5d6c74-6a90-4d8d-bd1d-b5c3f4f65fed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:04.073968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:04.074962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 283/561] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:04.076576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d6c74-6a90-4d8d-bd1d-b5c3f4f65fed None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-6ec613ae-64f3-4fb3-a9d8-a9b09047baf4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:04.081933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:04.084120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:04.086401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 279/562] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:04.087733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba973e2-440d-4c5f-9274-83f76dc3d3bc None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.087733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba973e2-440d-4c5f-9274-83f76dc3d3bc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.087733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba973e2-440d-4c5f-9274-83f76dc3d3bc None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.088494 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 280/563] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:04.089599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443eb7-3f4a-43bf-bab1-2d7e6c797a65 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.090389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443eb7-3f4a-43bf-bab1-2d7e6c797a65 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.090389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443eb7-3f4a-43bf-bab1-2d7e6c797a65 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.091255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 281/564] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:04.091950 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443eb7-3f4a-43bf-bab1-2d7e6c797a65 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.160477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.179219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d6c74-6a90-4d8d-bd1d-b5c3f4f65fed None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.194068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443eb7-3f4a-43bf-bab1-2d7e6c797a65 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.220625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.221528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.221874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.222344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.230628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:04.232062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:04.238097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb352e8-e850-46b6-a656-ea5d8ab77080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.238770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb352e8-e850-46b6-a656-ea5d8ab77080 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.239046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb352e8-e850-46b6-a656-ea5d8ab77080 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.239324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb352e8-e850-46b6-a656-ea5d8ab77080 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.239992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb352e8-e850-46b6-a656-ea5d8ab77080 None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:04.240299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb352e8-e850-46b6-a656-ea5d8ab77080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:04.241773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb352e8-e850-46b6-a656-ea5d8ab77080 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:04.243548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:04.244498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 284/565] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:04.245671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.254723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 282/566] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:04.255851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63eb3e-53b8-4ee1-9710-53a4517507c6 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.257965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63eb3e-53b8-4ee1-9710-53a4517507c6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.257965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63eb3e-53b8-4ee1-9710-53a4517507c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.274681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4f63eb3e-53b8-4ee1-9710-53a4517507c6 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:04.276772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4f63eb3e-53b8-4ee1-9710-53a4517507c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:04.289945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.343485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 283/567] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:04.344679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249c1c-67fd-49d6-8e79-56c8ff5b03ed None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.344925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249c1c-67fd-49d6-8e79-56c8ff5b03ed None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.345234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c249c1c-67fd-49d6-8e79-56c8ff5b03ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.351653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba54ba3-fa16-41eb-83b6-653009e41add None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.370372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-3c249c1c-67fd-49d6-8e79-56c8ff5b03ed None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:04.371559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3c249c1c-67fd-49d6-8e79-56c8ff5b03ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:04.390065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.390678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.390960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.391233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.392092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:04.392400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:04.393866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:04.403650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.413610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 285/568] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:04.419411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.440063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 284/569] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:04.441195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c249c1c-67fd-49d6-8e79-56c8ff5b03ed None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.536669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ad9f4-e9d3-435b-9aae-f753d3a51efa None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.550038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.572344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.573678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.574030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.574369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.575152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:04.575442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:04.577025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:04.580237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c249c1c-67fd-49d6-8e79-56c8ff5b03ed None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.593001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 286/570] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:04.593001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.627119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.627749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.628035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.628309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.638866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:04.640302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:04.658168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:04.659205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:04.660102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:04.660102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:04.660102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:04.660102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 285/571] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:04.660334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.665836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.708573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b77dc-ed7a-4e00-be49-589d513fbc61 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.744140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.744802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.745114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.745388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.756123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:04.757612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:04.766046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a0f85-7ca3-46ae-9031-c59ed6730cd1 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:04.771606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:04.772668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:04.773596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:04.773596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:04.773596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:04.773596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 287/572] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:04.773596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.799241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.805395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.806077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.806287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.806563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.807377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=939c785e259f445a97c737152ae96a6e) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:04.812427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:04.812427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:04.814376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 286/573] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/role_assignments?user.id=939c785e259f445a97c737152ae96a6e&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:04.815160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.895374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b37fc-9aa6-4c16-807c-ba870324f23d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.910304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:04.941684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7822e-d858-49e3-a0c3-40f02d62d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:04.942598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7822e-d858-49e3-a0c3-40f02d62d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:04.943229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7822e-d858-49e3-a0c3-40f02d62d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:04.943673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7822e-d858-49e3-a0c3-40f02d62d6e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:04.956941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7822e-d858-49e3-a0c3-40f02d62d6e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:04.957995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d89a-f84f-4822-a926-f31c2b906898 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f3e7822e-d858-49e3-a0c3-40f02d62d6e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:04.963365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:04.965797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 288/574] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:04.966696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7822e-d858-49e3-a0c3-40f02d62d6e4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:04.999552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.000273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.000548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.000822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.001616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:05.002027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.003425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.018789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 287/575] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:05.019489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.086029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7822e-d858-49e3-a0c3-40f02d62d6e4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.089400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:05.127028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb60f4-dd71-4ea5-8966-fb32e47d7c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.127720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb60f4-dd71-4ea5-8966-fb32e47d7c86 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.128004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb60f4-dd71-4ea5-8966-fb32e47d7c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.128280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb60f4-dd71-4ea5-8966-fb32e47d7c86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.142273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb60f4-dd71-4ea5-8966-fb32e47d7c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:05.148279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d266a9c-36f5-4d89-8a80-fc280cb7db5c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4bcb60f4-dd71-4ea5-8966-fb32e47d7c86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:05.148783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:05.149946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 289/576] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:05.151088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb60f4-dd71-4ea5-8966-fb32e47d7c86 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.186015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:05.193539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.194149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.194694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.194967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.195625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:05.195929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.197482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.214228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 288/577] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:05.214228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.276826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb60f4-dd71-4ea5-8966-fb32e47d7c86 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.344205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.345357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.345875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.346373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.347657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:05.348229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.350637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.363106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 290/578] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:05.364003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.387364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30176697-995e-4754-a2a8-9355cbf37a34 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.403711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:05.425884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.426514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.426898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.427167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] PATH_INFO: `/v3/users/nova` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.435909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.437022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:05.450199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:05.451522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 289/579] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:05.452680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.470000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:05.480288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ad31-6ac4-4713-8d41-5f8717b89199 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.522708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.523170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.523556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.523830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.524627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:05.524931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.528427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.537543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 291/580] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:05.542169 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.585999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5546c47-f957-48e7-9beb-1f2b2cf096da None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.630494 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.631133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.631417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.631696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.641364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.643609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:05.658704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:05.659739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 290/581] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:05.660627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.667198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471294f-b5a6-4182-b5a0-609260a448b6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.710222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:05.711882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.712533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.712820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.713129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.724789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.726288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:05.743911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:05.745671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:05.746549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:05.746549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:05.746549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:05.746549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 292/582] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:05.746549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.760777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:05.799978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f6c38-3f41-483b-8783-34a0a0965b2e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.844363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.845392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.845908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.846238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.846989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:05.847293 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.848762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.873495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 291/583] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:05.874299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:05.884166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22869-719b-4508-860e-70def7a6c358 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:05.941470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:05.941470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:05.941470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:05.941470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:05.953154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:05.955425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:05.972137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:05.973221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:05.974196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:05.974196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:05.974196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:05.974196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 293/584] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:05.974433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.009284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:06.022218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1126e-136a-4009-938a-ca20c10f4097 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.047204 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:06.064586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.065566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.066067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.066630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.067562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:06.068051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.071314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:06.090677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 292/585] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:06.090677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.101120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc2684-46c2-47e4-9e24-59ce9b4b4dad None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.145619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.146231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.146517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.147114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.147442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:06.147751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.149159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:06.168239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 294/586] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:06.169710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.225173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc8c8f-9b03-4301-97a1-31cde468960a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.282629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.283415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.283618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.283805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.298083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.300189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:06.317886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:06.325119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:06.326097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:06.326097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:06.326097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:06.326097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 293/587] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:06.326097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.334341 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:06.335774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5de8e2-0364-4dd0-a816-5fb0506e2ea0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.359891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:06.380572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.381337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.381687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.382022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.382758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:06.383139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.384569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:06.403518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 295/588] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:06.404888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.465853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e40fc4-667c-430d-9400-8c37f6e3d838 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.508245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247f555-c6ab-408d-9fd7-37e35db06ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.508506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247f555-c6ab-408d-9fd7-37e35db06ebb None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.508777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247f555-c6ab-408d-9fd7-37e35db06ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.509088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247f555-c6ab-408d-9fd7-37e35db06ebb None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/66a29dd8d28f44f0b311d167fd39b4f6/roles/1fadb9cbee8341babab0edab4777200f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.526838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e1396-26bf-4106-8f17-30d9d0dadcf7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.528176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247f555-c6ab-408d-9fd7-37e35db06ebb None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=66a29dd8d28f44f0b311d167fd39b4f6, role_id=1fadb9cbee8341babab0edab4777200f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.529792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247f555-c6ab-408d-9fd7-37e35db06ebb None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:06.568682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.569347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.569633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.569905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.578380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.579956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:06.592103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:06.598392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 296/589] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:06.599594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.626560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 294/590] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:06 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/66a29dd8d28f44f0b311d167fd39b4f6/roles/1fadb9cbee8341babab0edab4777200f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:12:06.627461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247f555-c6ab-408d-9fd7-37e35db06ebb None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.659920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:06.711190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:06.755248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978292c4-b915-4c1f-a0da-b24c3088c4e6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.781089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247f555-c6ab-408d-9fd7-37e35db06ebb None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.809479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.810377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.810807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.811218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.812025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:06.812483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.814146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:06.826277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.826947 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.827235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.827512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.828245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 297/591] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:06.829290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.840760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.842284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:06.857259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:06.858319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 295/592] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:06.859441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:06.948968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:06.954338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e1bf0-4059-47b5-9aa4-aaddaa74b246 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.976704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af120fca-1d47-4f9a-8573-9b3e06d3dd70 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:06.991344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d8685-4eb8-40b2-82c0-166f3845b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:06.992465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8685-4eb8-40b2-82c0-166f3845b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:06.993132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8685-4eb8-40b2-82c0-166f3845b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:06.993755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8685-4eb8-40b2-82c0-166f3845b1c7 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:06.994222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:06.994800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d8685-4eb8-40b2-82c0-166f3845b1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:06.995128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d8685-4eb8-40b2-82c0-166f3845b1c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:06.996572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d8685-4eb8-40b2-82c0-166f3845b1c7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.019367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 298/593] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Sep 5 12:12:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:07.019562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.019562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.019562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.019562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.019868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0c59-5694-44af-aeb6-b997e086a964 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.019868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0c59-5694-44af-aeb6-b997e086a964 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.019868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0c59-5694-44af-aeb6-b997e086a964 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.019868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 299/594] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:07.019868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da0c59-5694-44af-aeb6-b997e086a964 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.031217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:07.032605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:07.045583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:07.046813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:07.047714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:07.047714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:07.047714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:07.047714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:07.047714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:07.047714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:07.047714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:07.047714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:07.051443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 296/595] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:07.052298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.144507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da0c59-5694-44af-aeb6-b997e086a964 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.166075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcea88-1b1a-418f-a1cf-67b2117cd7dc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.182903 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573340db-899b-409f-83d2-93ac864a0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.183653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573340db-899b-409f-83d2-93ac864a0308 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.184033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573340db-899b-409f-83d2-93ac864a0308 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.184381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573340db-899b-409f-83d2-93ac864a0308 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.185214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573340db-899b-409f-83d2-93ac864a0308 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:07.185690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573340db-899b-409f-83d2-93ac864a0308 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:07.187031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573340db-899b-409f-83d2-93ac864a0308 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.204961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.209950 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 300/596] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Sep 5 12:12:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:07.210090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.210090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.210090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.210365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68ec7-2c37-46e3-9c70-b9fc462bd671 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.210365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68ec7-2c37-46e3-9c70-b9fc462bd671 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.210365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68ec7-2c37-46e3-9c70-b9fc462bd671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.220580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:07.222188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.227073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cfb68ec7-2c37-46e3-9c70-b9fc462bd671 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:07.228383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cfb68ec7-2c37-46e3-9c70-b9fc462bd671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:07.238070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:07.239237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:07.240238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:07.240238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:07.240238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:07.240238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 297/597] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:07.240985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.241575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:07.272401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:07.309393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 301/598] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:07.309393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb68ec7-2c37-46e3-9c70-b9fc462bd671 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.357736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4148dc1-824b-4104-9012-426571681e86 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.403781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.404767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.405248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.405723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.406829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:07.408188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:07.409843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.428142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 298/599] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:07.429530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.442854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb68ec7-2c37-46e3-9c70-b9fc462bd671 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.491110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.492307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.492770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.493490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.508523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:07.511016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.516832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:07.531988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:07.534147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:07.536162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:07.536162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:07.536162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:07.536162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 302/600] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:07.536162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.567569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:07.585948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb74bf-28d7-4615-aeab-c9e34337265b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.637213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.637837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.638123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.638400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.639060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:07.639367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:07.640759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.658356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 299/601] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:07.658356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.668539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8c6e6-2096-40db-aba1-686d4d61f747 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.706473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb378052-e649-429a-9590-fd08050e1e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.707235 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb378052-e649-429a-9590-fd08050e1e40 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.707585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb378052-e649-429a-9590-fd08050e1e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.707957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb378052-e649-429a-9590-fd08050e1e40 None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/2029f59c77de4240a78dba6960735bde/roles/1fadb9cbee8341babab0edab4777200f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.723790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb378052-e649-429a-9590-fd08050e1e40 None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=2029f59c77de4240a78dba6960735bde, role_id=1fadb9cbee8341babab0edab4777200f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:07.725264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb378052-e649-429a-9590-fd08050e1e40 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.767005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddbd0c-c9b2-4b01-ac81-422165a94dd8 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.797524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 303/602] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:07 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/2029f59c77de4240a78dba6960735bde/roles/1fadb9cbee8341babab0edab4777200f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:12:07.798352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb378052-e649-429a-9590-fd08050e1e40 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.814054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.815276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.815713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.816767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:07.818065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:07.818606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:07.821183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:07.846728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 300/603] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:07.847726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:07.857410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:07.876362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:07.947406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb378052-e649-429a-9590-fd08050e1e40 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.991391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bbdfd-5f52-47a7-b32a-764f3a097e12 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:07.995507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b8b27-9187-4ab1-b84a-57956a8e63d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:07.996330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b8b27-9187-4ab1-b84a-57956a8e63d6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:07.996786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b8b27-9187-4ab1-b84a-57956a8e63d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:07.997226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b8b27-9187-4ab1-b84a-57956a8e63d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.011048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b8b27-9187-4ab1-b84a-57956a8e63d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-874b8b27-9187-4ab1-b84a-57956a8e63d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:08.016310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:08.017480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:08.018503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:08.020228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 304/604] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:08.021215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b8b27-9187-4ab1-b84a-57956a8e63d6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:08.035675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.036317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.036595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.036868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.044527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.046002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:08.058557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:08.059555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:08.060445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:08.060445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:08.060445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:08.060445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:08.060445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:08.060445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:08.060445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:08.060445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:08.064325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 301/605] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:08.065333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:08.146719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b8b27-9187-4ab1-b84a-57956a8e63d6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:08.147689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:08.155824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:08.185017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.185735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.186019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.186295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.186920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394212d3-6d32-4f02-8c3c-c4ed7bcb34ff None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:08.193563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.195028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:08.207815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:08.208731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:08.209658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 305/606] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:08.210136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:08.226208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.226834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.227119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.227392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.228065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:08.228369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.229801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.240450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 302/607] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:08.241324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:08.332570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5421ea8-f80b-4680-b3ba-903a96e1943b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:08.355134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c068024-6b8f-432b-821f-21003e13978c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:08.371712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.372328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.372625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.372894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.373617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:08.373931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.375368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.393256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 306/608] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:08.393256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:08.403039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:08.412570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.413563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.414026 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.422214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.422214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:08.422214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.422214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.422495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:08.433764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 303/609] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:08.434992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:08.503115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72579bb7-675d-42d8-a125-ae37d93eca53 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:08.539775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.540497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.540725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.540970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.550666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d514b-2496-451d-9836-ee837129bf66 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:08.551608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.553208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:08.569817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:08.570808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:08.571690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:08.571690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:08.571690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:08.576072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 307/610] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:08.576985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:08.594206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01f40-4f4a-468e-a48a-5c4aff9b38bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.595269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01f40-4f4a-468e-a48a-5c4aff9b38bb None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.595879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01f40-4f4a-468e-a48a-5c4aff9b38bb None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.596356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01f40-4f4a-468e-a48a-5c4aff9b38bb None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/fa7ce8d93f864130a3c079b1aec6b678/roles/1fadb9cbee8341babab0edab4777200f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.613831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed01f40-4f4a-468e-a48a-5c4aff9b38bb None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=fa7ce8d93f864130a3c079b1aec6b678, role_id=1fadb9cbee8341babab0edab4777200f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.615633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed01f40-4f4a-468e-a48a-5c4aff9b38bb None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.665648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:08.690792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26488307-a1dd-400b-a37a-c2c2edecce02 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:08.727708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 304/611] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:08 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/fa7ce8d93f864130a3c079b1aec6b678/roles/1fadb9cbee8341babab0edab4777200f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:12:08.727708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01f40-4f4a-468e-a48a-5c4aff9b38bb None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:08.754304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e97b3b-7b06-4ce2-807e-eae1a74b4684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.755308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b3b-7b06-4ce2-807e-eae1a74b4684 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.755716 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b3b-7b06-4ce2-807e-eae1a74b4684 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.756069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e97b3b-7b06-4ce2-807e-eae1a74b4684 None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/77ae8a6fe7ff4190aa3cd8c7f820d15b/roles/1fadb9cbee8341babab0edab4777200f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.774831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97b3b-7b06-4ce2-807e-eae1a74b4684 None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=77ae8a6fe7ff4190aa3cd8c7f820d15b, role_id=1fadb9cbee8341babab0edab4777200f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.777319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e97b3b-7b06-4ce2-807e-eae1a74b4684 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.784295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:08.859955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01f40-4f4a-468e-a48a-5c4aff9b38bb None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:08.878816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 308/612] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:08 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/77ae8a6fe7ff4190aa3cd8c7f820d15b/roles/1fadb9cbee8341babab0edab4777200f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:12:08.880390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2915a5-c318-4b7a-9e62-88046c8857ea None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.880740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2915a5-c318-4b7a-9e62-88046c8857ea None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.881044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2915a5-c318-4b7a-9e62-88046c8857ea None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.882377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 309/613] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:08.890430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6289b7-747d-4afd-a15a-6150b83e5949 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.890768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6289b7-747d-4afd-a15a-6150b83e5949 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.892580 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6289b7-747d-4afd-a15a-6150b83e5949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.906432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:08.907207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:08.907549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:08.907985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:08.908830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:08.909222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:08.910689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:08.924417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 305/614] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:08.927533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2e6289b7-747d-4afd-a15a-6150b83e5949 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:08.929432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2e6289b7-747d-4afd-a15a-6150b83e5949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:08.930083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:09.019299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 310/615] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:09.052796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:09.056689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229ffd6-b2bc-4636-9bab-f3cfcc372d9b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:09.094209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:09.094912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:09.095198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:09.095475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:09.104773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:09.106787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:09.120154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:09.121284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:09.122938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 306/616] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:09.127429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6289b7-747d-4afd-a15a-6150b83e5949 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:09.197858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:09.243833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6289b7-747d-4afd-a15a-6150b83e5949 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:09.285895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:09.286618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:09.286906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:09.287187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:09.287986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:09.288305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:09.289824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:09.312293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 311/617] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Sep 5 12:12:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:09.317721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:09.366143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:09.489674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f918d0c-ece7-4877-a8cc-adc5164748ad None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:09.510675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca7f9-7049-4799-9281-75366ec2d758 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:09.529307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:09.558708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1780b-2cd2-4ec7-bfbb-754323fc78f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:09.559355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1780b-2cd2-4ec7-bfbb-754323fc78f6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:09.559625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1780b-2cd2-4ec7-bfbb-754323fc78f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:09.559891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1780b-2cd2-4ec7-bfbb-754323fc78f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:09.577890 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1780b-2cd2-4ec7-bfbb-754323fc78f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-b7d1780b-2cd2-4ec7-bfbb-754323fc78f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:09.582996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:09.583917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:09.585085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:09.585803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:09.585894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 312/618] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:09.585964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:09.585964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:09.585964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:09.594039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1780b-2cd2-4ec7-bfbb-754323fc78f6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:09.608564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:09.610073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:09.638004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:09.640456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:09.642640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:09.642640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:09.642640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:09.642640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 307/619] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:09.645967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:09.662906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:09.773960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0f035-2f12-4acd-80d5-474039f90778 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:09.798219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1780b-2cd2-4ec7-bfbb-754323fc78f6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:09.852421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:09.853233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:09.853615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:09.854020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:09.854809 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:09.855214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:09.856690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:09.858921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:09.859543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:09.859825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:09.860136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:09.860858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:09.861243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:09.862863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:09.872986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 313/620] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:09.873187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:09.891795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 308/621] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:09.897154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:09.917384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:09.982575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed712ae-45a6-4fca-b7bb-84c406a6076a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:10.019798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:10.020627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.021064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.021443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.035144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:10.036731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:10.052696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:10.053904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:10.055000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:10.055000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:10.055000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:10.061057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 314/622] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:10.062591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:10.063008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:10.102026 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99a498-78e3-48a8-8675-0a7493ccfffd None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:10.139494 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b940e-0209-403b-9327-cfbe86fbb20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:10.140392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b940e-0209-403b-9327-cfbe86fbb20f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.140814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b940e-0209-403b-9327-cfbe86fbb20f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.141249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b940e-0209-403b-9327-cfbe86fbb20f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.148382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b940e-0209-403b-9327-cfbe86fbb20f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:10.150236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b940e-0209-403b-9327-cfbe86fbb20f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:10.159454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-db5b940e-0209-403b-9327-cfbe86fbb20f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:10.163763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:10.164820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:10.165943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:10.165943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:10.165943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:10.165943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:10.165943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:10.165943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:10.165943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:10.165943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:10.168559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 309/623] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:10.169912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a87b4-bf56-4183-ad74-f5ca46529dd5 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.170335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a87b4-bf56-4183-ad74-f5ca46529dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.170768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a87b4-bf56-4183-ad74-f5ca46529dd5 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.172334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 310/624] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:10.173744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a87b4-bf56-4183-ad74-f5ca46529dd5 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:10.177047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580c580-84dd-4ace-b69c-eb480f76df7b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:10.212883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a2dbb-f28a-4f8a-bd69-b22e20fe73e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:10.214253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2dbb-f28a-4f8a-bd69-b22e20fe73e6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.214641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2dbb-f28a-4f8a-bd69-b22e20fe73e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.215024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a2dbb-f28a-4f8a-bd69-b22e20fe73e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.215877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2dbb-f28a-4f8a-bd69-b22e20fe73e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:10.216289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2dbb-f28a-4f8a-bd69-b22e20fe73e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:10.218192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a2dbb-f28a-4f8a-bd69-b22e20fe73e6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:10.235871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 315/625] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:10.237394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3878-1eb4-476a-8a5c-49c0edac5edd None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.237824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3878-1eb4-476a-8a5c-49c0edac5edd None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.238208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3878-1eb4-476a-8a5c-49c0edac5edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.257869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-14be3878-1eb4-476a-8a5c-49c0edac5edd None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:10.259264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-14be3878-1eb4-476a-8a5c-49c0edac5edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:10.283846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a87b4-bf56-4183-ad74-f5ca46529dd5 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:10.324731 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:10.333630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:10.334749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.335197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.335608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.336704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:10.337602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:10.343434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:10.345391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 316/626] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:10.346522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be3878-1eb4-476a-8a5c-49c0edac5edd None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:10.354388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 311/627] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:10.359777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:10.530184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:10.567905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be3878-1eb4-476a-8a5c-49c0edac5edd None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:10.571840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363131ad-384f-4a00-898c-f1f5d0211f03 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:10.630711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406630c5-ac5c-40b6-b7e4-7ba570a232e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:10.631158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:10.631819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.632102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.632382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.632676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406630c5-ac5c-40b6-b7e4-7ba570a232e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.633209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406630c5-ac5c-40b6-b7e4-7ba570a232e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.633679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406630c5-ac5c-40b6-b7e4-7ba570a232e0 None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/939c785e259f445a97c737152ae96a6e/roles/1fadb9cbee8341babab0edab4777200f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.640663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:10.642164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:10.650299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406630c5-ac5c-40b6-b7e4-7ba570a232e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=939c785e259f445a97c737152ae96a6e, role_id=1fadb9cbee8341babab0edab4777200f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:10.652909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406630c5-ac5c-40b6-b7e4-7ba570a232e0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:10.656333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:10.657391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:10.658329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 317/628] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:10.658919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:10.734787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 312/629] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:10 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/939c785e259f445a97c737152ae96a6e/roles/1fadb9cbee8341babab0edab4777200f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:12:10.735873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406630c5-ac5c-40b6-b7e4-7ba570a232e0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:10.789120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b1e36-061c-42a7-bc1a-62d7e5c03508 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:10.797337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:10.875931 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406630c5-ac5c-40b6-b7e4-7ba570a232e0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:10.905864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2bb60-2dee-4bc4-812d-472918f35e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:10.906437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2bb60-2dee-4bc4-812d-472918f35e34 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.906719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2bb60-2dee-4bc4-812d-472918f35e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.906988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2bb60-2dee-4bc4-812d-472918f35e34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.920889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a662568-3c50-4902-8ab2-5a5f5cf41843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:10.921739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662568-3c50-4902-8ab2-5a5f5cf41843 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.927270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662568-3c50-4902-8ab2-5a5f5cf41843 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.927270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662568-3c50-4902-8ab2-5a5f5cf41843 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.927474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:10.927901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a662568-3c50-4902-8ab2-5a5f5cf41843 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:10.927901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a662568-3c50-4902-8ab2-5a5f5cf41843 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:10.927901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a662568-3c50-4902-8ab2-5a5f5cf41843 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:10.930883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2bb60-2dee-4bc4-812d-472918f35e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8ff2bb60-2dee-4bc4-812d-472918f35e34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:10.936709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:10.939139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 318/630] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:10.941255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17319fcb-f328-4a8e-91e6-16f34bf15cb2 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.943381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17319fcb-f328-4a8e-91e6-16f34bf15cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.943381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17319fcb-f328-4a8e-91e6-16f34bf15cb2 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.948995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 319/631] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:10.948995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17319fcb-f328-4a8e-91e6-16f34bf15cb2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:10.953037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 313/632] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Sep 5 12:12:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:10.961019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef805f4-744a-4bdc-85cc-75a56a0fdf21 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:10.961019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef805f4-744a-4bdc-85cc-75a56a0fdf21 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:10.961019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef805f4-744a-4bdc-85cc-75a56a0fdf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:10.984293 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-cef805f4-744a-4bdc-85cc-75a56a0fdf21 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:10.986593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-cef805f4-744a-4bdc-85cc-75a56a0fdf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:11.070267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17319fcb-f328-4a8e-91e6-16f34bf15cb2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:11.072020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 314/633] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:11.074729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef805f4-744a-4bdc-85cc-75a56a0fdf21 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:11.108636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:11.109535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.109819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.110094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.110779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:11.111087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:11.113061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:11.115224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:11.127792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 320/634] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:11.133824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:11.237486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:11.261943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621a1e6-c8cd-4438-a776-d1face771b43 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:11.301350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0642422-4ce2-47d5-a971-fcaba62d4da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:11.302049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0642422-4ce2-47d5-a971-fcaba62d4da1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.302337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0642422-4ce2-47d5-a971-fcaba62d4da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.302612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0642422-4ce2-47d5-a971-fcaba62d4da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.315199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0642422-4ce2-47d5-a971-fcaba62d4da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:11.318139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0642422-4ce2-47d5-a971-fcaba62d4da1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:11.320839 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef805f4-744a-4bdc-85cc-75a56a0fdf21 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d0642422-4ce2-47d5-a971-fcaba62d4da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:11.337902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:11.339023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:11.339945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:11.339945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:11.339945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:11.339945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 321/635] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:11.348438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1d339-28e2-468a-82b3-c4c0bdfac5f4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.352401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1d339-28e2-468a-82b3-c4c0bdfac5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.352401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1d339-28e2-468a-82b3-c4c0bdfac5f4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.354992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 322/636] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:11.355826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1d339-28e2-468a-82b3-c4c0bdfac5f4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:11.366042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b8d90-fd4d-45a9-8621-7e2fa193c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:11.366990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8d90-fd4d-45a9-8621-7e2fa193c8ee None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.367460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8d90-fd4d-45a9-8621-7e2fa193c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.368465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8d90-fd4d-45a9-8621-7e2fa193c8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.463120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b8d90-fd4d-45a9-8621-7e2fa193c8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:11.464447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b8d90-fd4d-45a9-8621-7e2fa193c8ee None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:11.477696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1d339-28e2-468a-82b3-c4c0bdfac5f4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:11.493981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:11.495048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:11.520776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd2090-e0c2-4e2d-b14c-db697f7a3243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:11.521512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2090-e0c2-4e2d-b14c-db697f7a3243 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.521799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2090-e0c2-4e2d-b14c-db697f7a3243 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.522075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd2090-e0c2-4e2d-b14c-db697f7a3243 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.522730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd2090-e0c2-4e2d-b14c-db697f7a3243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:11.523036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd2090-e0c2-4e2d-b14c-db697f7a3243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:11.524600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd2090-e0c2-4e2d-b14c-db697f7a3243 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:11.543725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 323/637] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:11.543725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218616f-0a2d-4a20-9de3-da9feaedb979 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.543725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218616f-0a2d-4a20-9de3-da9feaedb979 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.543725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218616f-0a2d-4a20-9de3-da9feaedb979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.562359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6218616f-0a2d-4a20-9de3-da9feaedb979 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:11.563576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6218616f-0a2d-4a20-9de3-da9feaedb979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:11.579806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 315/638] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:11.579806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b8d90-fd4d-45a9-8621-7e2fa193c8ee None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:11.661015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 324/639] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:11.661015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218616f-0a2d-4a20-9de3-da9feaedb979 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:11.712302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b8d90-fd4d-45a9-8621-7e2fa193c8ee None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:11.745179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:11.755161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31363f89-6847-462c-bd66-b6c6832f94e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:11.758533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363f89-6847-462c-bd66-b6c6832f94e8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.758533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363f89-6847-462c-bd66-b6c6832f94e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.758533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363f89-6847-462c-bd66-b6c6832f94e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.767159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31363f89-6847-462c-bd66-b6c6832f94e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-31363f89-6847-462c-bd66-b6c6832f94e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:11.772349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:11.773438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:11.774606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 316/640] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:11.775649 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31363f89-6847-462c-bd66-b6c6832f94e8 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:11.810992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218616f-0a2d-4a20-9de3-da9feaedb979 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:11.814532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:11.850513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:11.851054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.851342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.851615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.859906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:11.861394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:11.874273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:11.875279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:11.876222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:11.880123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 325/641] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:12:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:11.881167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:11.903959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31363f89-6847-462c-bd66-b6c6832f94e8 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:11.943412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:11.944528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:11.945081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:11.945551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:11.957812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:11.959819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:11.976539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:11.977783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:11.978834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:11.978834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:11.978834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:11.978834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 317/642] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:11.978834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:11.997619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcd0d1-e474-4b87-8d35-3b89d846fd43 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.027007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:12.037708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.038537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.038815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.039086 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.039759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:12.040059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:12.041611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:12.050036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 326/643] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:12.050850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.084873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:12.091366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62bcf-79fa-4444-bac3-cd9c797d7294 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.128590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.129238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.129540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.129798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.130539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:12.130848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:12.132357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:12.151783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 318/644] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:12:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:12.152625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.176249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f08dd-e355-4d49-b10a-ba0fd05cc3ed None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.230512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae296-0170-470a-896d-d60752b9b2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.231159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae296-0170-470a-896d-d60752b9b2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.231437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae296-0170-470a-896d-d60752b9b2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.231788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeae296-0170-470a-896d-d60752b9b2d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.245111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeae296-0170-470a-896d-d60752b9b2d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-fbeae296-0170-470a-896d-d60752b9b2d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:12.250763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:12.251745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:12.252798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:12.256463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 327/645] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:12.261547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae296-0170-470a-896d-d60752b9b2d4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.296195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:12.300990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834e9d2-2204-4a84-9208-242d12c4e54a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.348927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.349897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.350199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.350474 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.351141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:12.351448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:12.352833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:12.366463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 319/646] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:12.368224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.376035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:12.396051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeae296-0170-470a-896d-d60752b9b2d4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.438577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.439232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.439529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.439778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.451921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:12.454278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:12.472269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:12.473762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:12.475359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:12.475359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:12.475359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:12.478409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 328/647] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:12.479991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.520428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d6d76-ef1d-4da2-8337-4d4a2d99c82e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.558064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1fe4f-68aa-4f10-ba46-388a7441957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.558785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1fe4f-68aa-4f10-ba46-388a7441957e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.559066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1fe4f-68aa-4f10-ba46-388a7441957e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.559336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1fe4f-68aa-4f10-ba46-388a7441957e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.589425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:12.600824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5792db-0423-4ead-af1c-92c1cdeda128 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.633951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1fe4f-68aa-4f10-ba46-388a7441957e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:12.636404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1fe4f-68aa-4f10-ba46-388a7441957e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:12.636898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.637537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.637818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.638089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.638906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:12.639323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:12.640687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:12.646161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:12.650299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 329/648] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:12.652317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.755044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 320/649] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:12.756183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1fe4f-68aa-4f10-ba46-388a7441957e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.773869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19dbc0-2255-4f53-9a36-94465719792a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.813304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.814277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.814754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.815220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.820917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:12.823370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:12.824855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:12.839300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:12.840250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 330/650] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:12.846579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.873498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1fe4f-68aa-4f10-ba46-388a7441957e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.909566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.910406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.910592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.910938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:12.911693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:12.911892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:12.911997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:12.913405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:12.926235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 321/651] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:12.927082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:12.959073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cff142-fa36-4513-8256-e01f4180492d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:12.995269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:12.995907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:12.996191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:12.996464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.007344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.008800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:13.023958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:13.025126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:13.026970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:13.026970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:13.026970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:13.026970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 331/652] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:13.027210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.038528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bdfb3-bddd-483a-9243-0f9959fc832b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.057914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:13.074945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b5a50-cf85-41fd-819d-f54e1ab95671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.075620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5a50-cf85-41fd-819d-f54e1ab95671 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.075945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5a50-cf85-41fd-819d-f54e1ab95671 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.076211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b5a50-cf85-41fd-819d-f54e1ab95671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.088094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b5a50-cf85-41fd-819d-f54e1ab95671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.089655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b5a50-cf85-41fd-819d-f54e1ab95671 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-414b5a50-cf85-41fd-819d-f54e1ab95671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:13.104694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:13.110659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 322/653] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022caf45-3bdb-4d08-ae45-63bc3d37e7b5 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022caf45-3bdb-4d08-ae45-63bc3d37e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022caf45-3bdb-4d08-ae45-63bc3d37e7b5 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 323/654] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:13.111766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022caf45-3bdb-4d08-ae45-63bc3d37e7b5 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.147046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc705704-2100-40e5-b0b4-394165b743f0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.161360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:13.183307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.183923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.184213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.184515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.185249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:13.185560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.187003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.200353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 332/655] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:13.201248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.230853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022caf45-3bdb-4d08-ae45-63bc3d37e7b5 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.268124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.268762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.269082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.269362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.283434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.283434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:13.293479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:13.294622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:13.295593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 324/656] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:13.296214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.310632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe4a9c-06d6-4902-9d70-a6cd93208e18 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.330490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:13.348136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf44ca2-4abe-4515-8523-371149c94360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.348777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44ca2-4abe-4515-8523-371149c94360 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.349089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44ca2-4abe-4515-8523-371149c94360 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.349359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44ca2-4abe-4515-8523-371149c94360 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.350017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44ca2-4abe-4515-8523-371149c94360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:13.350324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44ca2-4abe-4515-8523-371149c94360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.351708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf44ca2-4abe-4515-8523-371149c94360 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.369135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 333/657] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:13.369135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120c7bf-0e98-4869-8eba-b9b871996d46 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.369135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120c7bf-0e98-4869-8eba-b9b871996d46 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.369135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120c7bf-0e98-4869-8eba-b9b871996d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.385354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8120c7bf-0e98-4869-8eba-b9b871996d46 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:13.386558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8120c7bf-0e98-4869-8eba-b9b871996d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:13.410286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9760323-5ff0-4229-9ff1-a08e648dac29 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.412969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:13.447515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.448162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.448419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.448766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.449417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:13.449718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.451163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.458269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 334/658] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:13.458896 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120c7bf-0e98-4869-8eba-b9b871996d46 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.464762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 325/659] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:13.465755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.593656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120c7bf-0e98-4869-8eba-b9b871996d46 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.595682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:13.607878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a118a9-a77b-41ac-94ea-614d28449f70 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.645655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.646270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.646549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.646823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.647565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=66a29dd8d28f44f0b311d167fd39b4f6) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:13.647875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.649618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.654262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.654886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.655170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.655444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.656198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:13.656510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.657471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 335/660] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/role_assignments?user.id=66a29dd8d28f44f0b311d167fd39b4f6&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:13.658020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.658862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.687545 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 326/661] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:13.689493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.722255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:13.841992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c367ec2-5ea3-46f2-9ab7-556e9aaf7626 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.850801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f089dc-e989-445b-b026-67e36f3c40c7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:13.888770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.889444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.889730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.889999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.894746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:13.895382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:13.895661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:13.895930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:13.897792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.899494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.904708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:13.906263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:13.914617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:13.915665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:13.916674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 336/662] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:13.917363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:13.918772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:13.920738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 327/663] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:13.922982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:13.937554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:14.014086 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:14.030440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1218e-11d5-4e9f-837c-1c7213ed33d5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:14.047577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41574877-9e00-40a7-a7e2-942de5609c32 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:14.070952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb812e-7b96-4f4d-a0a2-ccba028748d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:14.071577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb812e-7b96-4f4d-a0a2-ccba028748d3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:14.071861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb812e-7b96-4f4d-a0a2-ccba028748d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:14.072132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb812e-7b96-4f4d-a0a2-ccba028748d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:14.087269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49f73c-5a89-4dec-9874-4e62fc540349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:14.088061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49f73c-5a89-4dec-9874-4e62fc540349 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:14.088898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49f73c-5a89-4dec-9874-4e62fc540349 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:14.089220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49f73c-5a89-4dec-9874-4e62fc540349 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:14.102421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49f73c-5a89-4dec-9874-4e62fc540349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ab49f73c-5a89-4dec-9874-4e62fc540349 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:14.107458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:14.109218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 328/664] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:14.110502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49f73c-5a89-4dec-9874-4e62fc540349 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:14.193189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb812e-7b96-4f4d-a0a2-ccba028748d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:14.196155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb812e-7b96-4f4d-a0a2-ccba028748d3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:14.224069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:14.260846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49f73c-5a89-4dec-9874-4e62fc540349 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:14.306531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:14.307211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:14.307496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:14.307776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:14.308527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:14.308838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:14.310381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:14.318349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:14.341000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 329/665] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Sep 5 12:12:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:14.341000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:14.341417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 337/666] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:14.341417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb812e-7b96-4f4d-a0a2-ccba028748d3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:14.458978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb812e-7b96-4f4d-a0a2-ccba028748d3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:14.471856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c33b76-b070-4fd0-b381-764a2792ee01 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:14.497332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:14.497952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:14.498233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:14.498506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:14.499183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:14.499493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:14.500863 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:14.502702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:14.510295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 338/667] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:14.512346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:14.512346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:14.519737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:14.519737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:14.519737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:14.519737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:14.520034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:14.520112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:14.530371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 330/668] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:14.531301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:14.583954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:14.642568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57817ca1-bf2d-4b0b-b143-7889213d54fc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:14.643576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f5b62-2f36-4091-a4d5-9970896b57af None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:14.682043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:14.682678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:14.682999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:14.683224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:14.686480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccfa34-761a-44a8-b2f2-be3580602fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:14.687102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccfa34-761a-44a8-b2f2-be3580602fdc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:14.687385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccfa34-761a-44a8-b2f2-be3580602fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:14.687659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccfa34-761a-44a8-b2f2-be3580602fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:14.698477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:14.700381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:14.719399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:14.720390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:14.721645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:14.721645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:14.721645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:14.721645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 339/669] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:14.721645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:14.756790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:14.772034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccfa34-761a-44a8-b2f2-be3580602fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:14.773715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccfa34-761a-44a8-b2f2-be3580602fdc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:14.853669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:14.857212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358349ef-1f27-432f-aa04-3e1d494a10a1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:14.901584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:14.902534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:14.902798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:14.903174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:14.915748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:14.917479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:14.939635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 331/670] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:14.939635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccfa34-761a-44a8-b2f2-be3580602fdc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:14.940253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:14.941155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:14.942219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:14.942219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:14.942219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:14.944584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 340/671] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:14.945670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.055043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:15.071646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed0c49-29b6-40ca-aed2-50df26360acd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.072940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccfa34-761a-44a8-b2f2-be3580602fdc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.107452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.108068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.108351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.108631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.109316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:15.109623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.111067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.123265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.128453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 341/672] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:15.128602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.128602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.128602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.128839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.128978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=2029f59c77de4240a78dba6960735bde) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:15.128978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.128978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.140984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 332/673] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:14 2022] GET /identity/v3/role_assignments?user.id=2029f59c77de4240a78dba6960735bde&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:15.140984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.151064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:15.285222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c005-381a-4c29-a3c0-cf71d56e779c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.298330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a378fb-3ab3-4fe1-8f0a-cd54f8ad36cb None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.339912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.340493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.340774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.341081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.344738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.346126 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.346415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.346697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.347371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:15.347679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.349520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.355536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.357057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.364753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 333/674] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:15.365783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:15.375704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:15.376731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:15.377715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:15.377715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:15.377715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:15.379191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 342/675] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:15.383666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.383831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:15.461925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:15.502688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7cc5d-8e7a-4e7e-a38a-033a9362fe0b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.516106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed569376-86df-42c2-88e0-eed14449aab2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.556617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.558293 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.559189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.559388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.559880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.560209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.560436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.560850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.570812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.572291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.578053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.581754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:15.586436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:15.587396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:15.589024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 343/676] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:15.593430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:15.601526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:15.602495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:15.603406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:15.603406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:15.603406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:15.603406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:15.603406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:15.603406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:15.603406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:15.603406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:15.606624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 334/677] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:15.608288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.705896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:15.725539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0c4e-6191-4b9f-bc0f-8aef12579f09 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.744250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd0576-07b7-43c9-a789-c8bea7c28355 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.753643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:15.766188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.766799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.767086 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.767841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.768033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:15.768299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.769694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.782931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 344/678] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:15.783613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.784555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6910ef-3b8b-4fe3-95c3-ff9cec32bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.789195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6910ef-3b8b-4fe3-95c3-ff9cec32bdaf None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.789195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6910ef-3b8b-4fe3-95c3-ff9cec32bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.789195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6910ef-3b8b-4fe3-95c3-ff9cec32bdaf None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.789195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6910ef-3b8b-4fe3-95c3-ff9cec32bdaf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:15.789195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6910ef-3b8b-4fe3-95c3-ff9cec32bdaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.789195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6910ef-3b8b-4fe3-95c3-ff9cec32bdaf None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.810057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 335/679] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:15.811408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a1ad-5722-4e67-adf3-5d507aab82ab None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.811694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a1ad-5722-4e67-adf3-5d507aab82ab None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.811968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41a1ad-5722-4e67-adf3-5d507aab82ab None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.813447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 336/680] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:15.814076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a1ad-5722-4e67-adf3-5d507aab82ab None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:15.929832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793941-6d96-4edf-af95-bd5150c1a829 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.942035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41a1ad-5722-4e67-adf3-5d507aab82ab None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:15.970730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:15.973140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.973766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.974042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.974479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.975195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:15.975556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.977030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.979251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68503c-251f-4489-ad5b-9ba4c4ce5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:15.979892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68503c-251f-4489-ad5b-9ba4c4ce5963 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:15.980177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68503c-251f-4489-ad5b-9ba4c4ce5963 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:15.980459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68503c-251f-4489-ad5b-9ba4c4ce5963 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:15.987635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68503c-251f-4489-ad5b-9ba4c4ce5963 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:15.991503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68503c-251f-4489-ad5b-9ba4c4ce5963 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:15.991614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 345/681] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:15.992209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-9f68503c-251f-4489-ad5b-9ba4c4ce5963 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:16.007488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:16.008729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 337/682] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:16.009887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659f50-a4d8-49da-a0a5-897583ee0172 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:16.011055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659f50-a4d8-49da-a0a5-897583ee0172 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:16.011055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659f50-a4d8-49da-a0a5-897583ee0172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:16.033114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f6659f50-a4d8-49da-a0a5-897583ee0172 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:16.034626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f6659f50-a4d8-49da-a0a5-897583ee0172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:16.052242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:16.112908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f1d7d-acd5-4f82-a041-496d1a5d3ef0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:16.114582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 338/683] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:16.115220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659f50-a4d8-49da-a0a5-897583ee0172 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:16.171821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf60e4-eb68-4289-88f2-f46c8f0142ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:16.173350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf60e4-eb68-4289-88f2-f46c8f0142ea None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:16.174180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf60e4-eb68-4289-88f2-f46c8f0142ea None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:16.175070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf60e4-eb68-4289-88f2-f46c8f0142ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:16.259704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659f50-a4d8-49da-a0a5-897583ee0172 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:16.280924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:16.282651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf60e4-eb68-4289-88f2-f46c8f0142ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:16.285717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf60e4-eb68-4289-88f2-f46c8f0142ea None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:16.303012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:16.303746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:16.304099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:16.304493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:16.305408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=fa7ce8d93f864130a3c079b1aec6b678) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:16.305809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:16.307515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:16.314969 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 339/684] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:16 2022] GET /identity/v3/role_assignments?user.id=fa7ce8d93f864130a3c079b1aec6b678&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:16.316005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:16.349334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:16.433541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 346/685] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:16.439510 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf60e4-eb68-4289-88f2-f46c8f0142ea None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:16.457614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48508daa-619c-424a-9f6d-7e9966244da6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:16.515519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:16.516108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:16.516389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:16.516666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:16.517426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:16.517756 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:16.519994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:16.537008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 340/686] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:16.537008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:16.582504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf60e4-eb68-4289-88f2-f46c8f0142ea None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:16.595106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:16.632039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:16.632674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:16.632971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:16.634019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:16.646424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:16.647894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:16.651842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:16.665830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:16.667431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:16.668904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:16.668904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:16.668904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:16.668904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 347/687] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:16.668904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:16.692818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d02c5-04d0-49c9-9ab8-8c6e152c7d28 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:16.742265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:16.743830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:16.744884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:16.745695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:16.762786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:16.765991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:16.794971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:16.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:16.796967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:16.796967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:16.796967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:16.805719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 341/688] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:16.807935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:16.809394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10924426-3b6f-4cf2-ac24-b5de833a9ed5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:16.862358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:16.863341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:16.863932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:16.864499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:16.865937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=77ae8a6fe7ff4190aa3cd8c7f820d15b) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:16.866471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:16.868689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:16.881828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 348/689] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:16 2022] GET /identity/v3/role_assignments?user.id=77ae8a6fe7ff4190aa3cd8c7f820d15b&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:16.881828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:16.963546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:16.979935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c76a45-ba50-427f-83df-8bd645c852a9 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:17.043482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:17.073875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:17.074519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:17.074809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:17.075089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:17.075778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:17.076131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:17.077621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:17.093854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 342/690] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:17.098200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e178448-0e18-49a3-9ff8-e2fd9bea5208 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:17.099485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:17.138255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:17.138983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:17.139335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:17.139614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:17.140276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:17.140579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:17.142001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:17.161102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 349/691] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:17.162728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:17.224251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbeca5-660d-4c9f-8725-63e6eb947dc3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:17.264203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:17.265265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:17.265764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:17.266244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:17.274588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:17.281242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:17.286077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902dec1-5b8e-4052-9d20-236b28c09444 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:17.290568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:17.292186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:17.293118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:17.293118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:17.293118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:17.293118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:17.293118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:17.293118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:17.293118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:17.293118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:17.297261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 343/692] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:17.306028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:17.316354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:17.329892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:17.334491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f000ac-5234-4099-9d14-5a8aa3f0390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:17.335152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f000ac-5234-4099-9d14-5a8aa3f0390d None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:17.335436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f000ac-5234-4099-9d14-5a8aa3f0390d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:17.335711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f000ac-5234-4099-9d14-5a8aa3f0390d None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:17.336384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f000ac-5234-4099-9d14-5a8aa3f0390d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:17.338778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f000ac-5234-4099-9d14-5a8aa3f0390d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:17.452426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 350/693] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:12:17 2022] POST /identity/v3/users => generated 254 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:12:17.455384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ac40-dd59-44e8-ab15-ec57ffe900db None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:17.455912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ac40-dd59-44e8-ab15-ec57ffe900db None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:17.456383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352ac40-dd59-44e8-ab15-ec57ffe900db None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:17.459354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 351/694] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:17.466945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6eea2-8abf-4dd4-b39a-1fc845027188 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:17.470335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6eea2-8abf-4dd4-b39a-1fc845027188 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:17.470335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6eea2-8abf-4dd4-b39a-1fc845027188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:17.488454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4653d3-79fc-4d9e-8026-073f49c09933 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:17.507699 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-72d6eea2-8abf-4dd4-b39a-1fc845027188 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:17.509036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-72d6eea2-8abf-4dd4-b39a-1fc845027188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:17.561610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:17.563161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:17.563444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:17.563711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:17.564468 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:17.564774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:17.566338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:17.599721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 344/695] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:17.613260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:17.661610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 352/696] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:17.784051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:17.836558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbd491-81d5-474b-885f-ef479c922f4b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:17.909087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:17.910102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:17.910574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:17.911032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:17.912285 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=939c785e259f445a97c737152ae96a6e) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:17.912796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:17.915409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:17.926875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 345/697] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:17 2022] GET /identity/v3/role_assignments?user.id=939c785e259f445a97c737152ae96a6e&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:17.976205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6eea2-8abf-4dd4-b39a-1fc845027188 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:18.099066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6eea2-8abf-4dd4-b39a-1fc845027188 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:18.108812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:18.149573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42075e9-f421-447f-84c5-60b8108bef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:18.150246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42075e9-f421-447f-84c5-60b8108bef28 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:18.151066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42075e9-f421-447f-84c5-60b8108bef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:18.151348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42075e9-f421-447f-84c5-60b8108bef28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:18.166819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42075e9-f421-447f-84c5-60b8108bef28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d42075e9-f421-447f-84c5-60b8108bef28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:18.172023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:18.173041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:18.173888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:18.177395 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 353/698] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:18.179860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:18.321157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a19fa2-bdae-41a8-8545-c3d29b3b68d5 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:18.362071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:18.363174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:18.363663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:18.364138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:18.365092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:18.365630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:18.367203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:18.373815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:18.379166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 346/699] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:18.384694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42075e9-f421-447f-84c5-60b8108bef28 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:18.508790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42075e9-f421-447f-84c5-60b8108bef28 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:18.548655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f666089-02cb-4907-9662-04bf84c438c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:18.549391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666089-02cb-4907-9662-04bf84c438c3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:18.549673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666089-02cb-4907-9662-04bf84c438c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:18.549946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666089-02cb-4907-9662-04bf84c438c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:18.564129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f666089-02cb-4907-9662-04bf84c438c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:18.565686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f666089-02cb-4907-9662-04bf84c438c3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8f666089-02cb-4907-9662-04bf84c438c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:18.582452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:18.583489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:18.584838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:18.584838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:18.584838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:18.584838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 354/700] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:18.592006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:18.730476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e40c-604d-45d0-819c-cdb55d25a31b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:18.770195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef010f8-8664-4683-bb08-491f84152699 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:18.770524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef010f8-8664-4683-bb08-491f84152699 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:18.770806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef010f8-8664-4683-bb08-491f84152699 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:18.772412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 355/701] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:18.778469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa626e-e59b-41d8-b186-72e099e6f935 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:18.778788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa626e-e59b-41d8-b186-72e099e6f935 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:18.779056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa626e-e59b-41d8-b186-72e099e6f935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:18.780743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:18.781381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:18.781661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:18.782040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:18.782895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:18.783198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:18.784675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:18.799114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4dfa626e-e59b-41d8-b186-72e099e6f935 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:18.800329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4dfa626e-e59b-41d8-b186-72e099e6f935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:18.806280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 347/702] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:18.813582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:18.818031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:18.921193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 356/703] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:12:18.936441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:19.003232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad29d4-8ea1-4412-8af3-4d7c4e0bd9bc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:19.065582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:19.066258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:19.066544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:19.066813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:19.075349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:19.076797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:19.088884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:19.089993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:19.091149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 348/704] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:12:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:19.097598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa626e-e59b-41d8-b186-72e099e6f935 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:19.251172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa626e-e59b-41d8-b186-72e099e6f935 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:19.323714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:19.324319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:19.324801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:19.325152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:19.326542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:19.327105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:19.329096 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:19.366934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 357/705] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:12:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:19.373342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:19.373861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:19.384416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:19.554938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f9dbc-99da-41c3-9504-4e181a4fcaee None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:19.566185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee135b1-ccdd-49ae-8701-f8eaf2aa0405 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:19.576378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:19.592126 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fb6b3-79c2-45cb-9f84-db9940ee9af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:19.592851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fb6b3-79c2-45cb-9f84-db9940ee9af5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:19.593175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fb6b3-79c2-45cb-9f84-db9940ee9af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:19.593447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fb6b3-79c2-45cb-9f84-db9940ee9af5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:19.603312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26bc02-36fd-45aa-b799-ec790d7ffe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:19.604001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26bc02-36fd-45aa-b799-ec790d7ffe32 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:19.604280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26bc02-36fd-45aa-b799-ec790d7ffe32 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:19.604551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26bc02-36fd-45aa-b799-ec790d7ffe32 None admin] PATH_INFO: `/v3/services/network` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:19.605173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26bc02-36fd-45aa-b799-ec790d7ffe32 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:19.606558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26bc02-36fd-45aa-b799-ec790d7ffe32 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1c26bc02-36fd-45aa-b799-ec790d7ffe32 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:19.617636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:19.618694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:19.620724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 358/706] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:19 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:19.621604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6064d-792e-491c-8296-f876161fabdb None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:19.621604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6064d-792e-491c-8296-f876161fabdb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:19.621604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6064d-792e-491c-8296-f876161fabdb None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:19.623615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 359/707] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:19.624995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6064d-792e-491c-8296-f876161fabdb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:19.699050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fb6b3-79c2-45cb-9f84-db9940ee9af5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:19.701013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fb6b3-79c2-45cb-9f84-db9940ee9af5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:19.719998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:19.757693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6064d-792e-491c-8296-f876161fabdb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:19.795611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772ee7b-b419-440d-ab7a-a88c8d4e39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:19.796530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ee7b-b419-440d-ab7a-a88c8d4e39f0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:19.797168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ee7b-b419-440d-ab7a-a88c8d4e39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:19.797651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ee7b-b419-440d-ab7a-a88c8d4e39f0 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:19.798607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772ee7b-b419-440d-ab7a-a88c8d4e39f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:19.799134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772ee7b-b419-440d-ab7a-a88c8d4e39f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:19.800728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772ee7b-b419-440d-ab7a-a88c8d4e39f0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:19.806448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 360/708] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:19.808535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553fac-acc9-4d47-8833-3661043f828a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:19.809055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553fac-acc9-4d47-8833-3661043f828a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:19.809559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553fac-acc9-4d47-8833-3661043f828a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:19.833146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0d553fac-acc9-4d47-8833-3661043f828a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:19.834778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0d553fac-acc9-4d47-8833-3661043f828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:19.912888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 349/709] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:19.912888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fb6b3-79c2-45cb-9f84-db9940ee9af5 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:19.913848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 361/710] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:19.915485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d553fac-acc9-4d47-8833-3661043f828a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:19.965112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:19.983715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:20.025372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d553fac-acc9-4d47-8833-3661043f828a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:20.064275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:20.065299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.065789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.066290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.077977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:20.079816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:20.096549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:20.097592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:20.098489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:20.098489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:20.098489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:20.104812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 362/711] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:20.107191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:20.168678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fb6b3-79c2-45cb-9f84-db9940ee9af5 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:20.213595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:20.214212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.214552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.214834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.215478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] RBAC: Adding query filter params (type=network) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:20.215781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:20.217179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:20.223454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 350/712] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:20.224281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:20.235807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be16e3-434d-4377-bd64-5021bf942c06 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:20.257617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:20.279166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:20.280275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.280771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.281493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.282444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:20.282970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:20.284822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:20.305647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 363/713] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:20.308453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:20.329388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:20.371685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000c021-fb54-47a1-b368-e8407eb55622 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:20.464436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043665f-916d-4ee6-89ec-9387f02cb49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:20.465551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043665f-916d-4ee6-89ec-9387f02cb49b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.466045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043665f-916d-4ee6-89ec-9387f02cb49b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.466535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043665f-916d-4ee6-89ec-9387f02cb49b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.467567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043665f-916d-4ee6-89ec-9387f02cb49b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:20.470140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043665f-916d-4ee6-89ec-9387f02cb49b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-0043665f-916d-4ee6-89ec-9387f02cb49b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:20.486781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:20.488053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:20.488983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 351/714] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Sep 5 12:12:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:20.490046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232518ca-292e-46d1-b9e9-fc9f41c19596 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.490046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232518ca-292e-46d1-b9e9-fc9f41c19596 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.490182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232518ca-292e-46d1-b9e9-fc9f41c19596 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.493007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 352/715] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:20.497881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9ad5-7d32-4bbf-a1d2-960d9fe13f50 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.498266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9ad5-7d32-4bbf-a1d2-960d9fe13f50 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.498476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee9ad5-7d32-4bbf-a1d2-960d9fe13f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.520847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2fee9ad5-7d32-4bbf-a1d2-960d9fe13f50 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:20.522971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2fee9ad5-7d32-4bbf-a1d2-960d9fe13f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:20.527454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3017f71-8254-4e1b-934d-8608dc1c1ebc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:20.567095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:20.568225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.568744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.569282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.578358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:20.580273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:20.592891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:20.594218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:20.595145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:20.595145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:20.595145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:20.595145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:20.595145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:20.595145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:20.595145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:20.595145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:20.597526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 364/716] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:20.598597 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:20.637188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 353/717] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:12:20.638763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee9ad5-7d32-4bbf-a1d2-960d9fe13f50 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:20.641084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:20.714043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f039e4-bd9a-4ec6-ab22-11aef68363d9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:20.754658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:20.755887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.756382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.756860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.757772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:20.758438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:20.760279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:20.765706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 365/718] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Sep 5 12:12:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:20.773552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:20.812332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:20.893222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee9ad5-7d32-4bbf-a1d2-960d9fe13f50 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:20.931506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7698807-012e-4fec-a06f-ac4dae0cee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:20.932156 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698807-012e-4fec-a06f-ac4dae0cee9c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.932440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698807-012e-4fec-a06f-ac4dae0cee9c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.932712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7698807-012e-4fec-a06f-ac4dae0cee9c None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.933460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698807-012e-4fec-a06f-ac4dae0cee9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:20.933929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698807-012e-4fec-a06f-ac4dae0cee9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:20.935514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7698807-012e-4fec-a06f-ac4dae0cee9c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:20.949315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 354/719] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:20.950594 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f429-ee88-4670-b1ab-ffa3ea792bf4 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.950884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f429-ee88-4670-b1ab-ffa3ea792bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.951166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921f429-ee88-4670-b1ab-ffa3ea792bf4 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.952604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 355/720] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:20.958629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363b9b-a186-42b6-900b-dcf899ab396b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:20.959000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363b9b-a186-42b6-900b-dcf899ab396b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:20.959350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7363b9b-a186-42b6-900b-dcf899ab396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:20.961618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:20.965201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42800aad-9b1e-4b79-9456-a50ab22f3b7c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:20.981904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f7363b9b-a186-42b6-900b-dcf899ab396b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:20.982576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f7363b9b-a186-42b6-900b-dcf899ab396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:21.005420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:21.006206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:21.007039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:21.007441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:21.008103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:21.008418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:21.010418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:21.016404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 366/721] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Sep 5 12:12:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:21.017345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:21.073381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 356/722] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:12:21.075009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7363b9b-a186-42b6-900b-dcf899ab396b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:21.148056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2943f4-dda6-42fe-b08e-e5b9454ecd42 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:21.216530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:21.221510 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:21.222798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:21.223481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:21.223948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:21.226233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=2029f59c77de4240a78dba6960735bde) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:21.226233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:21.227117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:21.245010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 367/723] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:21 2022] GET /identity/v3/role_assignments?user.id=2029f59c77de4240a78dba6960735bde&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=41491b52194f43e2902307fb86036726 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:21.278232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7363b9b-a186-42b6-900b-dcf899ab396b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:21.350064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2f3d4-93bc-4d44-bdc8-5e2601064775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:21.351128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f3d4-93bc-4d44-bdc8-5e2601064775 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:21.351595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f3d4-93bc-4d44-bdc8-5e2601064775 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:21.352073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2f3d4-93bc-4d44-bdc8-5e2601064775 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:21.372987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2f3d4-93bc-4d44-bdc8-5e2601064775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-b7a2f3d4-93bc-4d44-bdc8-5e2601064775 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:21.382856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:21.383855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:21.384800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:21.385533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 357/724] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:21.394275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2f3d4-93bc-4d44-bdc8-5e2601064775 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:21.394592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:21.449664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:21.561154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ff7d-05a7-406b-a3f5-323d404ced38 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:21.574817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2f3d4-93bc-4d44-bdc8-5e2601064775 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:21.625761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:21.630452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:21.631094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:21.631377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:21.631656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:21.634356 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:21.635761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:21.637229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:21.644785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ee184-f6dd-4502-8dbc-0d4dff3633fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:21.645485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ee184-f6dd-4502-8dbc-0d4dff3633fa None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:21.645768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ee184-f6dd-4502-8dbc-0d4dff3633fa None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:21.649324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ee184-f6dd-4502-8dbc-0d4dff3633fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:21.658677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 368/725] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:21.664726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:21.674496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ee184-f6dd-4502-8dbc-0d4dff3633fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-e63ee184-f6dd-4502-8dbc-0d4dff3633fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:21.681057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:21.682754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:21.683632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 358/726] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:21.692709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ee184-f6dd-4502-8dbc-0d4dff3633fa None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:21.838995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:21.863452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaba66d-dbdd-4373-a3c5-f1c6e68591a5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:21.920523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ee184-f6dd-4502-8dbc-0d4dff3633fa None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:21.943871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:21.944508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:21.944786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:21.945346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:21.966231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:21.967782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:21.995667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:21.996416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:21.996703 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:21.996994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:21.997678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:21.997987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:21.999372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:22.001995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:22.002984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:22.003887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:22.003887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:22.003887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:22.003887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 369/727] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:22.010739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:22.017043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 359/728] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:22.023998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:22.103399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:22.187441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc143f-cc74-4746-ab24-8bc3fc71e13d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:22.222446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ad4ad-9821-4f02-8062-685590f4f9b5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:22.243932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:22.244599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.244878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.245178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:22.265544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:22.267006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:22.283991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:22.284993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:22.285885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:22.285885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:22.285885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:22.285885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 360/729] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:22.291161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:22.292359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:22.293004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.293324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.293599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:22.296328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:22.296638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:22.298060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:22.326558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 370/730] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:22.332715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:22.335517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:22.477059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e5355-553a-42cb-a880-bcc80459beda None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:22.480657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:22.508743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ff39-05a9-4fdd-a9ee-0aaf4ce9f5b9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:22.544256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:22.544891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.545201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.545773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:22.553250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:22.554737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:22.558764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:22.559401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.559686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.559962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:22.560625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:22.560929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:22.562346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:22.567849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:22.568846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:22.570502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 371/731] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:12:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:22.575680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:22.589083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 361/732] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:22.595285 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:22.653836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:22.693237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b94f-7a74-4847-8f86-681937f67bc0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:22.723037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3fcbd8-6147-4a0f-93e7-3fe6a6d1c410 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:22.729898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f8814-1abc-4dc9-b72b-1e0b3712c9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:22.730445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f8814-1abc-4dc9-b72b-1e0b3712c9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.730722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f8814-1abc-4dc9-b72b-1e0b3712c9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.730991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f8814-1abc-4dc9-b72b-1e0b3712c9c8 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:22.732157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f8814-1abc-4dc9-b72b-1e0b3712c9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:22.732462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f8814-1abc-4dc9-b72b-1e0b3712c9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:22.734292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f8814-1abc-4dc9-b72b-1e0b3712c9c8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:22.757047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 372/733] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Sep 5 12:12:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:22.758341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2962e6-ccbb-4d3e-9f32-8b2e634c3a91 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.758627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2962e6-ccbb-4d3e-9f32-8b2e634c3a91 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.758901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2962e6-ccbb-4d3e-9f32-8b2e634c3a91 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:22.760394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 373/734] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:22.761926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2962e6-ccbb-4d3e-9f32-8b2e634c3a91 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:22.767127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b8da3-0fc5-44a8-9167-4e9d51951243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:22.767989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b8da3-0fc5-44a8-9167-4e9d51951243 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.768449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b8da3-0fc5-44a8-9167-4e9d51951243 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.768894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b8da3-0fc5-44a8-9167-4e9d51951243 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:22.777884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b8da3-0fc5-44a8-9167-4e9d51951243 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:22.779644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b8da3-0fc5-44a8-9167-4e9d51951243 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-545b8da3-0fc5-44a8-9167-4e9d51951243 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:22.793017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:22.793992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:22.794916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:22.802044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 362/735] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:22.802560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f42f-fd28-474d-8e47-ed41e1d278bf None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.802560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f42f-fd28-474d-8e47-ed41e1d278bf None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.802860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f42f-fd28-474d-8e47-ed41e1d278bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:22.825673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e6c1f42f-fd28-474d-8e47-ed41e1d278bf None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:22.829947 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e6c1f42f-fd28-474d-8e47-ed41e1d278bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:22.848256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:22.896899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2962e6-ccbb-4d3e-9f32-8b2e634c3a91 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:22.918048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 363/736] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:22.919128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f42f-fd28-474d-8e47-ed41e1d278bf None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:22.945346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:22.965088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6091f2-a875-4ed2-9e30-788ea8cddb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:22.965717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6091f2-a875-4ed2-9e30-788ea8cddb9a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:22.966001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6091f2-a875-4ed2-9e30-788ea8cddb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:22.966279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6091f2-a875-4ed2-9e30-788ea8cddb9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.107085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f42f-fd28-474d-8e47-ed41e1d278bf None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:23.139898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6091f2-a875-4ed2-9e30-788ea8cddb9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:23.144047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6091f2-a875-4ed2-9e30-788ea8cddb9a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:23.181326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:23.182533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.187464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.187464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.187464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:23.187464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:23.187464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:23.223595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 364/737] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Sep 5 12:12:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:23.225636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:23.257447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:23.350964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 374/738] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:23.352197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6091f2-a875-4ed2-9e30-788ea8cddb9a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:23.384077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb78f69-623a-4ea5-bb6e-e3fc2435a1c2 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:23.405542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:23.424187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751f34e-ddd2-46d3-aa36-d7a41d9a0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:23.425114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751f34e-ddd2-46d3-aa36-d7a41d9a0cbf None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.425762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751f34e-ddd2-46d3-aa36-d7a41d9a0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.427106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751f34e-ddd2-46d3-aa36-d7a41d9a0cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.506858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6091f2-a875-4ed2-9e30-788ea8cddb9a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:23.507429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751f34e-ddd2-46d3-aa36-d7a41d9a0cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:23.508917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751f34e-ddd2-46d3-aa36-d7a41d9a0cbf None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:23.524739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:23.560523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60d11f-4749-4834-ad8e-5b70f37fa947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:23.561189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d11f-4749-4834-ad8e-5b70f37fa947 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.561458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d11f-4749-4834-ad8e-5b70f37fa947 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.561737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d11f-4749-4834-ad8e-5b70f37fa947 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.562404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60d11f-4749-4834-ad8e-5b70f37fa947 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:23.563775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60d11f-4749-4834-ad8e-5b70f37fa947 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:23.624476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 365/739] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:12:23.625375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751f34e-ddd2-46d3-aa36-d7a41d9a0cbf None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:23.648730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 375/740] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:12:23 2022] POST /identity/v3/services => generated 240 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:23.650121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a62ba-6364-42e5-8d45-911cc2abcdc3 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.650442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a62ba-6364-42e5-8d45-911cc2abcdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.650984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a62ba-6364-42e5-8d45-911cc2abcdc3 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.652210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 376/741] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:23.660106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276891c7-30cf-4316-b934-7c60f2f166e1 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.660106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276891c7-30cf-4316-b934-7c60f2f166e1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.660106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276891c7-30cf-4316-b934-7c60f2f166e1 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.660106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 377/742] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:23.660106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276891c7-30cf-4316-b934-7c60f2f166e1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:23.755484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:23.756622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751f34e-ddd2-46d3-aa36-d7a41d9a0cbf None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:23.768632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:23.792686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276891c7-30cf-4316-b934-7c60f2f166e1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:23.795085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60763b-b7d7-4d72-978f-edb3223715fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:23.795824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60763b-b7d7-4d72-978f-edb3223715fd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.796255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60763b-b7d7-4d72-978f-edb3223715fd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.796530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60763b-b7d7-4d72-978f-edb3223715fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.808175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60763b-b7d7-4d72-978f-edb3223715fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:23.810725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60763b-b7d7-4d72-978f-edb3223715fd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-0e60763b-b7d7-4d72-978f-edb3223715fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:23.825929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:23.826966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:23.827869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:23.827869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:23.827869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:23.827869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 366/743] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:23.833329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff39a-620d-43d6-af3f-d083ed0bf05c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.833329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff39a-620d-43d6-af3f-d083ed0bf05c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.833329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff39a-620d-43d6-af3f-d083ed0bf05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.840007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576a96a-1288-4381-8ffd-48e0ba0bfae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:23.840653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a96a-1288-4381-8ffd-48e0ba0bfae7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.840933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a96a-1288-4381-8ffd-48e0ba0bfae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.841234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a96a-1288-4381-8ffd-48e0ba0bfae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.848550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f03ff39a-620d-43d6-af3f-d083ed0bf05c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:23.849812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f03ff39a-620d-43d6-af3f-d083ed0bf05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:23.852417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576a96a-1288-4381-8ffd-48e0ba0bfae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:23.854674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576a96a-1288-4381-8ffd-48e0ba0bfae7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f576a96a-1288-4381-8ffd-48e0ba0bfae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:23.873604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:23.874640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:23.875548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:23.875548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:23.875548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:23.875548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 378/744] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:23.876652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f20a9-4579-4542-922f-518a4ec2103e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:23.876652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f20a9-4579-4542-922f-518a4ec2103e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:23.876652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f20a9-4579-4542-922f-518a4ec2103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:23.896321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a00f20a9-4579-4542-922f-518a4ec2103e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:23.897547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a00f20a9-4579-4542-922f-518a4ec2103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:23.933335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 367/745] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:23 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:23.933335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff39a-620d-43d6-af3f-d083ed0bf05c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:23.977660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 379/746] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:23 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:12:23.979403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f20a9-4579-4542-922f-518a4ec2103e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.089197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:24.089916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:24.106428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff39a-620d-43d6-af3f-d083ed0bf05c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.149415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f20a9-4579-4542-922f-518a4ec2103e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.166814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:24.167438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:24.167712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:24.167982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:24.168641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:24.168937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:24.170429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:24.186115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 368/747] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:24.191467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.211632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:24.212278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:24.212565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:24.213422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:24.214086 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:24.214392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:24.215785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:24.229774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 380/748] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:24.235260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.314372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc99f-f93f-4cd6-b8fe-46244948ca02 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.350367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:24.351000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:24.351271 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:24.351533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:24.358982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:24.360417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:24.371860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:24.372753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:24.374103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 369/749] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:24.378286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.384115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5510f-d498-44dc-b2ff-92f32e5720ee None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.395400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:24.403649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:24.425600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:24.426351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:24.426548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:24.426789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:24.433513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:24.434984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:24.448013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:24.448900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:24.449860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 381/750] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:24.450360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.496720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf85b2-6eaf-429e-9dd5-f540b153a4ee None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.533027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709ab90-0728-4718-a95d-134b87255163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:24.533638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709ab90-0728-4718-a95d-134b87255163 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:24.533915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709ab90-0728-4718-a95d-134b87255163 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:24.534179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709ab90-0728-4718-a95d-134b87255163 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:24.534935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709ab90-0728-4718-a95d-134b87255163 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:24.536475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709ab90-0728-4718-a95d-134b87255163 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:24.562201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e517a-d218-4edc-bf08-d882574002a0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.611689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956f3c-47b8-4c80-94f5-f397cc313024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:24.612327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956f3c-47b8-4c80-94f5-f397cc313024 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:24.612612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956f3c-47b8-4c80-94f5-f397cc313024 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:24.612892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5956f3c-47b8-4c80-94f5-f397cc313024 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:24.620826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 370/751] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:12:24 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:24.621996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709ab90-0728-4718-a95d-134b87255163 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.634243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5956f3c-47b8-4c80-94f5-f397cc313024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f5956f3c-47b8-4c80-94f5-f397cc313024 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:24.643079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:24.644322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:24.645403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:24.648512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 382/752] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:24.649623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956f3c-47b8-4c80-94f5-f397cc313024 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.717775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:24.723434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:24.778726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709ab90-0728-4718-a95d-134b87255163 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.799577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5956f3c-47b8-4c80-94f5-f397cc313024 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.824359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:24.825858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:24.825858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:24.825858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:24.826259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:24.828755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:24.828755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:24.843466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 371/753] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:24.844613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.860979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:24.861818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:24.862005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:24.862252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:24.865887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:24.866229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:24.867885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:24.881975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 383/754] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:24.882811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:24.968452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f1f7c-6506-424d-b816-2b9141040fa6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:24.997575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:25.006601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:25.006856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:25.007559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.009227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.009227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.009227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:25.009501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:25.011725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:25.011843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93dff-d563-47c3-b797-0eaddbf2782c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:25.023783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 372/755] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:25.024755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:25.052659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:25.053398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.053679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.053948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.054671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=7160f78808c54480acff300737dcb15c) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:25.054975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:25.057166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:25.069243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 384/756] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:24 2022] GET /identity/v3/role_assignments?user.id=7160f78808c54480acff300737dcb15c&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:25.070254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:25.137940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48be17d-deea-4dda-acce-dbc23a02ff0e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:25.202820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:25.205847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.206152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.206426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.207205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=939c785e259f445a97c737152ae96a6e) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:25.207556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:25.209068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:25.232517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 373/757] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:25 2022] GET /identity/v3/role_assignments?user.id=939c785e259f445a97c737152ae96a6e&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=41491b52194f43e2902307fb86036726 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:25.267990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838d15d-d820-44e2-847a-92edb343f95a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:25.326008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:25.326681 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.326967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.327239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.341998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:25.344170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:25.361768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:25.364185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:25.366341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:25.366341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:25.366341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:25.366341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 385/758] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:25.370654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:25.464846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:25.524150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d648577-b6e3-4dbb-a230-17913cb3c253 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:25.571255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:25.571869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.572691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.573006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.573670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:25.573983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:25.575371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:25.596313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 374/759] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:25.601522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:25.625756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:25.717326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8005f9-2e6f-4496-9bea-f06c932fb3e0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:25.753072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949134a-0e07-416f-a5f9-b3e3bbfdebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:25.753989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949134a-0e07-416f-a5f9-b3e3bbfdebe2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.754412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949134a-0e07-416f-a5f9-b3e3bbfdebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.754823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949134a-0e07-416f-a5f9-b3e3bbfdebe2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.763249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949134a-0e07-416f-a5f9-b3e3bbfdebe2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:25.764872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949134a-0e07-416f-a5f9-b3e3bbfdebe2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-e949134a-0e07-416f-a5f9-b3e3bbfdebe2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:25.777232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:25.778351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:25.779494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:25.781637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 386/760] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:12:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:25.788979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:25.927196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356748-db1c-4651-931e-6edb4084b079 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.927749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356748-db1c-4651-931e-6edb4084b079 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.928168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1356748-db1c-4651-931e-6edb4084b079 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.929923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 387/761] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:25.938260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ffa71-2b69-48cb-be94-c532271c6bd9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.938737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ffa71-2b69-48cb-be94-c532271c6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.939178 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ffa71-2b69-48cb-be94-c532271c6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.946036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08609b6-52ce-4cda-9400-eaacffabe032 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:25.966071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:25.971534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-602ffa71-2b69-48cb-be94-c532271c6bd9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:25.972979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-602ffa71-2b69-48cb-be94-c532271c6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:25.996487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:25.997136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:25.997422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:25.997697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:25.998432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:25.998740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:26.000180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:26.037278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 375/762] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:12:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:26.045010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:26.074915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 388/763] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:26.202630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45874c70-8b27-4aa2-8ea4-23ccb516e736 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:26.249885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:26.250890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:26.251370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:26.251833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:26.268738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:26.270568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:26.288629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:26.289763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:26.290899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:26.290899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:26.290899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:26.293067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 376/764] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:26.302113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ffa71-2b69-48cb-be94-c532271c6bd9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:26.321937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:26.356898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:26.398718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:26.478166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a0541-9eb9-4baa-9632-81dce6a02e53 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:26.532826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:26.533900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:26.534184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:26.534456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:26.535055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:26.536513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:26.547301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:26.548305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:26.549787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 377/765] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:26 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:26.554138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:26.566994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ffa71-2b69-48cb-be94-c532271c6bd9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:26.645355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:26.646125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:26.646295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:26.646570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:26.647237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:26.647539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:26.649441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:26.675825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 389/766] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:26.679379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:26.718105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:26.742152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5afa1e-6cf9-4910-91c6-c837f0634ff7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:26.798033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:26.798651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:26.798897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:26.799105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:26.799747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] RBAC: Adding query filter params (name=network) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:26.800057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:26.807475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:26.808065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:26.816100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 378/767] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:26.825938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:26.892105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ec21d-e524-4e03-ae7f-7aa7d0654805 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:26.941967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8d02a-b68d-4538-bc3f-dde16062ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:26.942993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d02a-b68d-4538-bc3f-dde16062ed15 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:26.943478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d02a-b68d-4538-bc3f-dde16062ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:26.943950 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8d02a-b68d-4538-bc3f-dde16062ed15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:26.952102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8d02a-b68d-4538-bc3f-dde16062ed15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:26.953847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8d02a-b68d-4538-bc3f-dde16062ed15 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-3ba8d02a-b68d-4538-bc3f-dde16062ed15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:26.965887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:26.966824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:26.967726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:26.967726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:26.967726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:26.967726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:26.967726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:26.967726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:26.967726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:26.967726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:26.970143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 390/768] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:26.971609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ab7aa-967f-40f0-816d-c515f79d8744 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:26.972093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ab7aa-967f-40f0-816d-c515f79d8744 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:26.972565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ab7aa-967f-40f0-816d-c515f79d8744 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:26.974029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 391/769] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:26.979529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ab7aa-967f-40f0-816d-c515f79d8744 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:26.990758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d52a7-9eb5-4f80-8938-0d0326619870 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:27.036560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfef311-706b-490c-a7ef-cc332de9e84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:27.037207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfef311-706b-490c-a7ef-cc332de9e84d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.037495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfef311-706b-490c-a7ef-cc332de9e84d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.037775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfef311-706b-490c-a7ef-cc332de9e84d None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.038418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfef311-706b-490c-a7ef-cc332de9e84d None admin] RBAC: Adding query filter params (type=network) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:27.038726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfef311-706b-490c-a7ef-cc332de9e84d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:27.040580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfef311-706b-490c-a7ef-cc332de9e84d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:27.049122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 379/770] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:27.050682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2668-5005-4927-a722-07865f611a26 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.051197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2668-5005-4927-a722-07865f611a26 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.051668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd2668-5005-4927-a722-07865f611a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.075893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f5cd2668-5005-4927-a722-07865f611a26 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:27.077464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f5cd2668-5005-4927-a722-07865f611a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:27.090393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:27.112644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ab7aa-967f-40f0-816d-c515f79d8744 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:27.147456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:27.157075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 380/771] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:27.158287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd2668-5005-4927-a722-07865f611a26 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:27.160340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:27.160962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.161249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.161562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.165114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:27.165114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:27.165114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:27.180235 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 392/772] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:27.187528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:27.313596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1432e-41d6-4ce0-95b7-bb2a362fb983 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:27.355848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bea74-f862-4c6c-b4d3-7482be659ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:27.356520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bea74-f862-4c6c-b4d3-7482be659ffd None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.356799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bea74-f862-4c6c-b4d3-7482be659ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.357119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bea74-f862-4c6c-b4d3-7482be659ffd None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/2029f59c77de4240a78dba6960735bde/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.359043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bea74-f862-4c6c-b4d3-7482be659ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=2029f59c77de4240a78dba6960735bde, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:27.360462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bea74-f862-4c6c-b4d3-7482be659ffd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:27.365810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd2668-5005-4927-a722-07865f611a26 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:27.402552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b074ab4-2e21-4f67-80d7-24fed855e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:27.403209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b074ab4-2e21-4f67-80d7-24fed855e604 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.403491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b074ab4-2e21-4f67-80d7-24fed855e604 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.403761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b074ab4-2e21-4f67-80d7-24fed855e604 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.404465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b074ab4-2e21-4f67-80d7-24fed855e604 None admin] RBAC: Adding query filter params (interface=public, service_id=14d8db7bb58e458d8741def004b26697, region_id=RegionOne) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:27.404773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b074ab4-2e21-4f67-80d7-24fed855e604 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:27.406232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b074ab4-2e21-4f67-80d7-24fed855e604 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:27.415980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 381/773] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Sep 5 12:12:27 2022] GET /identity/v3/endpoints?service_id=14d8db7bb58e458d8741def004b26697&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:27.420841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9e30-40a3-4c96-9d88-2ffb5396317f None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.420841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9e30-40a3-4c96-9d88-2ffb5396317f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.420841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9e30-40a3-4c96-9d88-2ffb5396317f None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.421625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 393/775] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:27 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/2029f59c77de4240a78dba6960735bde/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:12:27.422751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bea74-f862-4c6c-b4d3-7482be659ffd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:27.423450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 382/775] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:27.424584 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37e0ca-3151-403e-93c9-c451fa01754d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.424872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37e0ca-3151-403e-93c9-c451fa01754d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.425184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37e0ca-3151-403e-93c9-c451fa01754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.455260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ab37e0ca-3151-403e-93c9-c451fa01754d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:27.456983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ab37e0ca-3151-403e-93c9-c451fa01754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:27.462184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:27.535201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:27.565060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 383/776] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:27.566424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37e0ca-3151-403e-93c9-c451fa01754d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:27.598007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bea74-f862-4c6c-b4d3-7482be659ffd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:27.638710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ba196-3712-419d-b53b-c98cff664eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:27.639342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ba196-3712-419d-b53b-c98cff664eca None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.639665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ba196-3712-419d-b53b-c98cff664eca None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.639948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ba196-3712-419d-b53b-c98cff664eca None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.640620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ba196-3712-419d-b53b-c98cff664eca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:27.642051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ba196-3712-419d-b53b-c98cff664eca None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:27.647709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 394/777] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:12:27 2022] GET /identity/v3/services => generated 772 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:27.649152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5a5d-e589-47bb-b318-f5e6ef2a14bb None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.649442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5a5d-e589-47bb-b318-f5e6ef2a14bb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.649721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f5a5d-e589-47bb-b318-f5e6ef2a14bb None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.651498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 395/778] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:27.657228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14d480-2670-450c-9c03-092143bacd25 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.657527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14d480-2670-450c-9c03-092143bacd25 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.657787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14d480-2670-450c-9c03-092143bacd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.683587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7c14d480-2670-450c-9c03-092143bacd25 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:27.685131 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7c14d480-2670-450c-9c03-092143bacd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:27.693729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37e0ca-3151-403e-93c9-c451fa01754d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:27.743454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:27.744346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.744634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.744912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.745558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:27.746974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:27.757266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:27.758337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:27.759202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 384/779] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Sep 5 12:12:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:27.765620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:27.770747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:27.788495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 396/780] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:27.911802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea8de-b516-4e94-8609-4e942824ab72 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:27.928087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14d480-2670-450c-9c03-092143bacd25 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:27.956385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:27.957516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:27.958009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:27.958507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:27.959350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:27.959856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:27.961644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:27.978948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:27.982845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 385/781] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Sep 5 12:12:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:27.988366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.096359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14d480-2670-450c-9c03-092143bacd25 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.105323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:28.141609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923347-09bc-497b-be87-b6dc5f25992b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.179408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.180036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.180323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.180601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.181301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:28.182164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:28.183585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:28.189655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 386/782] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Sep 5 12:12:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:28.191050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.252288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0908d-5ba6-47c5-9b95-cea0e31d140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.253073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0908d-5ba6-47c5-9b95-cea0e31d140d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.253427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0908d-5ba6-47c5-9b95-cea0e31d140d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.253777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0908d-5ba6-47c5-9b95-cea0e31d140d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.269283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e0908d-5ba6-47c5-9b95-cea0e31d140d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-43e0908d-5ba6-47c5-9b95-cea0e31d140d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:28.277001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:28.279036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 397/783] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:28.280861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0908d-5ba6-47c5-9b95-cea0e31d140d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.311741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c01fc3-4396-4b61-a115-a124b431128f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.342676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:28.348999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60922a-b708-4951-afc4-f2d825f01fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.349853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60922a-b708-4951-afc4-f2d825f01fdb None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.350143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60922a-b708-4951-afc4-f2d825f01fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.350419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60922a-b708-4951-afc4-f2d825f01fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.371484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60922a-b708-4951-afc4-f2d825f01fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ed60922a-b708-4951-afc4-f2d825f01fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:28.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:28.377327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:28.378185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:28.382359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 387/784] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:28.383227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60922a-b708-4951-afc4-f2d825f01fdb None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.425989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:28.432288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0908d-5ba6-47c5-9b95-cea0e31d140d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.481098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.482382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.483115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.483607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.485146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] RBAC: Adding query filter params (interface=public, service_id=f877992debc148a08ed36efec35c4573, region_id=RegionOne) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:28.485642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:28.488155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:28.492994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60922a-b708-4951-afc4-f2d825f01fdb None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.499302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 398/785] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Sep 5 12:12:28 2022] GET /identity/v3/endpoints?service_id=f877992debc148a08ed36efec35c4573&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:28.500345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.547433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.548614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.549111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.549576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.550664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:28.551182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:28.553618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:28.564325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 388/786] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:28.565528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.631443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91dc7a-effe-4acd-8553-6dcbca313719 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.643793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:28.679257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.680172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.680679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.681050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.682812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:28.683192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:28.684645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:28.698771 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee497-c0e9-4882-926c-036bea5856b3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.701119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 399/787] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:28.703032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.733456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:28.740296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de430e9-f32f-4a12-8ac5-b3c9f62d5271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.741215 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de430e9-f32f-4a12-8ac5-b3c9f62d5271 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.741654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de430e9-f32f-4a12-8ac5-b3c9f62d5271 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.742138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de430e9-f32f-4a12-8ac5-b3c9f62d5271 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.747572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de430e9-f32f-4a12-8ac5-b3c9f62d5271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:28.747572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de430e9-f32f-4a12-8ac5-b3c9f62d5271 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:28.751140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 389/788] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:12:28 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:28.752200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de430e9-f32f-4a12-8ac5-b3c9f62d5271 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.871400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d33f4-2c8f-46b1-a12c-23f551187b15 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.886994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de430e9-f32f-4a12-8ac5-b3c9f62d5271 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:28.910531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:28.926376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.927725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.928154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.928599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.942351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:28.944099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:28.946792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:28.948063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:28.948569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:28.948569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:28.964763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:28.966032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:28.967115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:28.967115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:28.967115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:28.973723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 390/789] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:28.978939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:28.982415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:28.984468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:29.020216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:29.021542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:29.022512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:29.022512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:29.022512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:29.027932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 400/790] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:29.043701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:29.126058 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883438df-a8fd-4a0e-a6ef-c9d510c3b587 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:29.168725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:29.189587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:29.190224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.190534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.190814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.191470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:29.191775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:29.193180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:29.196379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc39dc-41e6-4dc3-bf3a-413e9aa14f8c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:29.222574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 391/791] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:29.228933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:29.241193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:29.241193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.241559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.241559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.242223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:29.242524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:29.249505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:29.276138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 401/792] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:29.283284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:29.297625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:29.411967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03808824-4a3b-499b-a629-caf95ebad9c6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:29.464568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:29.465168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.465449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.465722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.479961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:29.481463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:29.507267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9240d-bfd5-4892-8843-828a979c573f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:29.513233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:29.514536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:29.515720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:29.517173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 392/793] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:29.539391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:29.589739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:29.590663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.591129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.591551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.595477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:29.601649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:29.608973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:29.627422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:29.628649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:29.635423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 402/794] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:12:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:29.641196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:29.683229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:29.701745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0fd07-6bce-4b0a-aabc-e01d0176aaa1 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:29.740850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08d0bc-2609-4071-ae8a-0944513e53db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:29.741419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08d0bc-2609-4071-ae8a-0944513e53db None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.741708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08d0bc-2609-4071-ae8a-0944513e53db None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.741985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08d0bc-2609-4071-ae8a-0944513e53db None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.742734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08d0bc-2609-4071-ae8a-0944513e53db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:29.743054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08d0bc-2609-4071-ae8a-0944513e53db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:29.745124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08d0bc-2609-4071-ae8a-0944513e53db None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:29.764653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 393/795] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Sep 5 12:12:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:29.765948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbe92-f4f1-40f4-9624-5ba7fdc0e98f None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.766255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbe92-f4f1-40f4-9624-5ba7fdc0e98f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.766512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbe92-f4f1-40f4-9624-5ba7fdc0e98f None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.772488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 394/796] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:29.773472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfbe92-f4f1-40f4-9624-5ba7fdc0e98f None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:29.817691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e67b9-3b7e-44f4-b414-3e2f52cced5b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:29.865899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31656a-5449-4a89-983a-77ca1f931749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:29.865899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31656a-5449-4a89-983a-77ca1f931749 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.865899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31656a-5449-4a89-983a-77ca1f931749 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.866263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31656a-5449-4a89-983a-77ca1f931749 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.866684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31656a-5449-4a89-983a-77ca1f931749 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:29.866988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31656a-5449-4a89-983a-77ca1f931749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:29.868438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31656a-5449-4a89-983a-77ca1f931749 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:29.888544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 403/797] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Sep 5 12:12:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:29.889960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfb38-118e-4d0b-ad0c-54014427443c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.890418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfb38-118e-4d0b-ad0c-54014427443c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.890553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dfb38-118e-4d0b-ad0c-54014427443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.901662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfbe92-f4f1-40f4-9624-5ba7fdc0e98f None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:29.912628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6b2dfb38-118e-4d0b-ad0c-54014427443c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:29.915183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6b2dfb38-118e-4d0b-ad0c-54014427443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:29.944044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e04134-b9b8-48b1-a7cf-a7d71b0d66ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:29.944799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e04134-b9b8-48b1-a7cf-a7d71b0d66ab None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:29.945022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e04134-b9b8-48b1-a7cf-a7d71b0d66ab None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:29.945295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e04134-b9b8-48b1-a7cf-a7d71b0d66ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:29.955857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e04134-b9b8-48b1-a7cf-a7d71b0d66ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:29.958059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e04134-b9b8-48b1-a7cf-a7d71b0d66ab None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:29.974723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:30.001068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 404/798] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:30.001068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa6720-4a5c-4d49-95a5-5d44376cb026 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.001068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa6720-4a5c-4d49-95a5-5d44376cb026 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.001068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa6720-4a5c-4d49-95a5-5d44376cb026 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.001068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 405/799] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:30.001591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa6720-4a5c-4d49-95a5-5d44376cb026 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.093160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-a0e04134-b9b8-48b1-a7cf-a7d71b0d66ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:30.101279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:30.113376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:30.114369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:30.114369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:30.114369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:30.114369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 395/800] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:30.114369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f769794-4a37-4bfe-bf64-9fa0b6960628 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.114369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f769794-4a37-4bfe-bf64-9fa0b6960628 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.114369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f769794-4a37-4bfe-bf64-9fa0b6960628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.128792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2f769794-4a37-4bfe-bf64-9fa0b6960628 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:30.130565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2f769794-4a37-4bfe-bf64-9fa0b6960628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:30.150987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa6720-4a5c-4d49-95a5-5d44376cb026 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.192073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:30.193187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.193679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.194185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.206484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:30.208334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:30.222425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 396/801] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:30.223540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f769794-4a37-4bfe-bf64-9fa0b6960628 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:30.227698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:30.229981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:30.230901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:30.230901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:30.230901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:30.232926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 406/802] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:30.239936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.285881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:30.347862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f769794-4a37-4bfe-bf64-9fa0b6960628 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.364270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7c2cc-f531-4625-828e-40f6670756c8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.379846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:30.386690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:30.387661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.388159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.388603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.389516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:30.390020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:30.391658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:30.405602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 397/803] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:30.413787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.418114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:30.418752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.419046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.419316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.420093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:30.420407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:30.421824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:30.444098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 407/804] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:30.449005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.558278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d643d5c-c706-4c0a-9e74-6b9a00157429 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.591296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:30.599630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5576420-b663-415a-9bd4-34cdd5a80dcd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.606690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:30.607326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.608059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.608059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.615594 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:30.617509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:30.633061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:30.634086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 398/805] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:30.635643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.638870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702d27f-0464-4902-b672-ad52c316ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:30.639675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702d27f-0464-4902-b672-ad52c316ab5d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.639982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702d27f-0464-4902-b672-ad52c316ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.640293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702d27f-0464-4902-b672-ad52c316ab5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.653525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702d27f-0464-4902-b672-ad52c316ab5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2702d27f-0464-4902-b672-ad52c316ab5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:30.658534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:30.659675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:30.660536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 408/806] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:30.661274 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702d27f-0464-4902-b672-ad52c316ab5d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.704625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:30.758648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb772f-7d3a-471b-877a-81aacb440286 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.772855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702d27f-0464-4902-b672-ad52c316ab5d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.794638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:30.795361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.795710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.796046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.804764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:30.806364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:30.813026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:30.813608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.813894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.814168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] PATH_INFO: `/v3/services/network` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.814757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:30.816118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:30.819006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:30.820103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 399/807] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:30.821255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:30.832384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:30.833970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:30.834837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 409/808] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:30.835657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:30.859846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:30.945810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6bfb8-a8c9-4c2d-9a18-88ee0e16f7bf None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.957282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5674-8747-429f-8484-e998fd2f694e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:30.960203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:30.986702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:30.987324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:30.987608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:30.987881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:30.988585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:30.988891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:30.990428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.004906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 400/809] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:31.005955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:31.011730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.012349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.012628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.012898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.013599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:31.014646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.015292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.024743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 410/810] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:31.026572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:31.135342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:31.141958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26b586-36ab-4636-a0ca-2087ddb73913 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:31.156902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64283b2d-1b42-4700-acbc-850dd053701e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:31.189329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.190636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.190986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.191270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.191997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:31.192394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.194309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.201204 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.202228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.202574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.202959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.203637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] RBAC: Adding query filter params (name=network) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:31.203957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.205389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.208723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 401/811] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:31.209467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:31.215918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 411/812] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:31.216739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:31.261130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:31.337279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da3625-37f4-42c0-90e7-fd83a3df8b3c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:31.338428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283bc49-497c-44e9-9656-2299f3d9cbdd None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:31.374310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.374609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa795d6b-eba2-48d8-b59a-92b1f68fd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.374961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.375231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.375456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa795d6b-eba2-48d8-b59a-92b1f68fd523 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.375619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.375894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa795d6b-eba2-48d8-b59a-92b1f68fd523 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.376330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa795d6b-eba2-48d8-b59a-92b1f68fd523 None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/939c785e259f445a97c737152ae96a6e/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.378772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa795d6b-eba2-48d8-b59a-92b1f68fd523 None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=939c785e259f445a97c737152ae96a6e, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.380357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa795d6b-eba2-48d8-b59a-92b1f68fd523 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.387968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.389394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.396764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:31.406139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:31.407309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:31.408656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:31.408656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:31.408656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:31.408656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 412/813] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:31.408656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:31.466923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 402/814] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:31 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/939c785e259f445a97c737152ae96a6e/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:12:31.468253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa795d6b-eba2-48d8-b59a-92b1f68fd523 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:31.546075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c0894-6e30-4799-a463-9e2fd855c23f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:31.597461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc43604-fbf2-40b9-83ee-a67b5cef3941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.598158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc43604-fbf2-40b9-83ee-a67b5cef3941 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.598438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc43604-fbf2-40b9-83ee-a67b5cef3941 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.598713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc43604-fbf2-40b9-83ee-a67b5cef3941 None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/7160f78808c54480acff300737dcb15c/roles/1fadb9cbee8341babab0edab4777200f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.614951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:31.622123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc43604-fbf2-40b9-83ee-a67b5cef3941 None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=7160f78808c54480acff300737dcb15c, role_id=1fadb9cbee8341babab0edab4777200f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.623613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc43604-fbf2-40b9-83ee-a67b5cef3941 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.633111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa795d6b-eba2-48d8-b59a-92b1f68fd523 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:31.672651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d36a7d-cf2c-4cf4-a127-a494749b4ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.673224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36a7d-cf2c-4cf4-a127-a494749b4ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.673511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36a7d-cf2c-4cf4-a127-a494749b4ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.673785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d36a7d-cf2c-4cf4-a127-a494749b4ae6 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.674429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d36a7d-cf2c-4cf4-a127-a494749b4ae6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:31.674735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d36a7d-cf2c-4cf4-a127-a494749b4ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.676196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d36a7d-cf2c-4cf4-a127-a494749b4ae6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.687169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 403/815] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:31.687169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf23c-d5d4-4970-8e03-8fce4d1ffc90 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.687169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf23c-d5d4-4970-8e03-8fce4d1ffc90 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.687169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faf23c-d5d4-4970-8e03-8fce4d1ffc90 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.687169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 404/816] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:31.687169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faf23c-d5d4-4970-8e03-8fce4d1ffc90 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:31.711908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 413/817] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:31 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/7160f78808c54480acff300737dcb15c/roles/1fadb9cbee8341babab0edab4777200f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:12:31.721989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc43604-fbf2-40b9-83ee-a67b5cef3941 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:31.800011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:31.836678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faf23c-d5d4-4970-8e03-8fce4d1ffc90 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:31.875652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc43604-fbf2-40b9-83ee-a67b5cef3941 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:31.892535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d6c4-a239-49c2-bc90-52c8e56b068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.893190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d6c4-a239-49c2-bc90-52c8e56b068b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.893467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d6c4-a239-49c2-bc90-52c8e56b068b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.893746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d6c4-a239-49c2-bc90-52c8e56b068b None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.894718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d6c4-a239-49c2-bc90-52c8e56b068b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:31.895030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d6c4-a239-49c2-bc90-52c8e56b068b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.896576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d6c4-a239-49c2-bc90-52c8e56b068b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.913482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 405/818] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:31.915000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5eaa-e7b9-4fd1-a4e3-6c4728a15d61 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.915686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5eaa-e7b9-4fd1-a4e3-6c4728a15d61 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.916870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a5eaa-e7b9-4fd1-a4e3-6c4728a15d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.923247 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff635375-1af3-4a68-9cf8-5c368692343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:31.923797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff635375-1af3-4a68-9cf8-5c368692343c None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:31.924141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff635375-1af3-4a68-9cf8-5c368692343c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:31.924421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff635375-1af3-4a68-9cf8-5c368692343c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:31.925191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff635375-1af3-4a68-9cf8-5c368692343c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:31.926758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff635375-1af3-4a68-9cf8-5c368692343c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:31.949109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-9e8a5eaa-e7b9-4fd1-a4e3-6c4728a15d61 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:31.951399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9e8a5eaa-e7b9-4fd1-a4e3-6c4728a15d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:31.970993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:32.038265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 414/819] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:12:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:32.039684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff635375-1af3-4a68-9cf8-5c368692343c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:32.073467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 406/820] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:32.170321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff635375-1af3-4a68-9cf8-5c368692343c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:32.173622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:32.213155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:32.213812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:32.214090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:32.214360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:32.223481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:32.225517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:32.245028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:32.246038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:12:32.247015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:32.251845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 415/821] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:12:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:32.254185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a5eaa-e7b9-4fd1-a4e3-6c4728a15d61 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:32.421992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:32.426869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a5eaa-e7b9-4fd1-a4e3-6c4728a15d61 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:32.464684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:32.465675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:32.466169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:32.466646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:32.467699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:32.468210 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:32.470004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:32.480450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:32.491249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 407/822] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:12:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:32.498011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:32.536022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1ef3e-c6b6-4002-9933-20906e87c027 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:32.576629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:32.577910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:32.578394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:32.578936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:32.579728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:32.581321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:32.593432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:32.594888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:12:32.595963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:32.603895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 416/823] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Sep 5 12:12:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:32.605487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:32.612050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b727c0d-e945-497f-8287-dbf6e9f536a5 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:32.637864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:32.648465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238c6d0-7f88-4109-852e-c93e98539cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:32.649097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c6d0-7f88-4109-852e-c93e98539cdd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:32.649445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c6d0-7f88-4109-852e-c93e98539cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:32.649726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238c6d0-7f88-4109-852e-c93e98539cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:32.724046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:32.727947 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238c6d0-7f88-4109-852e-c93e98539cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:32.730268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238c6d0-7f88-4109-852e-c93e98539cdd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:32.734311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287403ad-c979-4005-a710-91253d1d39a8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:32.778687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:32.779680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:32.780224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:32.780694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:32.781583 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:32.782116 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:32.783759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:32.793591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 417/824] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Sep 5 12:12:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:32.796807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:32.865676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 408/825] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:12:32.866959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238c6d0-7f88-4109-852e-c93e98539cdd None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:32.927646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:32.938115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2c436-d5f5-4b38-9f65-0400b5b0b905 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:32.974467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:32.976018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:32.976507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:32.977013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:32.977852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:32.979340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:32.981261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:32.988452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:32.992938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 418/826] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Sep 5 12:12:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:32.995821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:32.999281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238c6d0-7f88-4109-852e-c93e98539cdd None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:33.043577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:33.044219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.044504 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.044782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.057146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:33.059261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:33.080829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:33.081858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:33.082794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:33.082794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:33.082794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:33.089981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 409/827] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:33.091484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:33.122838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efc213-fa07-4202-9428-abd2a2026b23 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:33.162816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf6415-7e14-48ee-98fd-f0704f9b4101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:33.163424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6415-7e14-48ee-98fd-f0704f9b4101 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.163707 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6415-7e14-48ee-98fd-f0704f9b4101 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.164027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf6415-7e14-48ee-98fd-f0704f9b4101 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.164713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf6415-7e14-48ee-98fd-f0704f9b4101 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:33.166690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf6415-7e14-48ee-98fd-f0704f9b4101 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:33.199808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3345d-8462-4b40-b3e7-1970a58d75d6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:33.239201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 419/828] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:12:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:33.259391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:33.260011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.260288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.260555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.261434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:33.261740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:33.263414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:33.279270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 410/829] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:33.286203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf6415-7e14-48ee-98fd-f0704f9b4101 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:33.306785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:33.417504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf6415-7e14-48ee-98fd-f0704f9b4101 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:33.456392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ecda7-50b1-4eb3-8791-4e154ce33f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:33.457473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecda7-50b1-4eb3-8791-4e154ce33f6c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.457980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecda7-50b1-4eb3-8791-4e154ce33f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.458406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ecda7-50b1-4eb3-8791-4e154ce33f6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.467184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ecda7-50b1-4eb3-8791-4e154ce33f6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:33.468880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ecda7-50b1-4eb3-8791-4e154ce33f6c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-3e5ecda7-50b1-4eb3-8791-4e154ce33f6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:33.482703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:33.483925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:33.485048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:33.485048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:33.485048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:33.485048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:33.485048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:33.485048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:33.485048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:33.485048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:33.487333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 420/830] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:33.493377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:33.508126 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:33.645298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f002a9-26f6-4749-814e-edf4d5857f90 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.645654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f002a9-26f6-4749-814e-edf4d5857f90 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.645838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f002a9-26f6-4749-814e-edf4d5857f90 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.647626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 421/831] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:33.654859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1206d-ab1c-40ed-92ba-c7c137bfb643 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.654859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1206d-ab1c-40ed-92ba-c7c137bfb643 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.654859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1206d-ab1c-40ed-92ba-c7c137bfb643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.680122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e7f1206d-ab1c-40ed-92ba-c7c137bfb643 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:33.683148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e7f1206d-ab1c-40ed-92ba-c7c137bfb643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:33.688395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb828e-f036-4b69-869e-77cc3586e550 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:33.729520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:33.730137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.730421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.730693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.731400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:33.731707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:33.733502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:33.750105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 411/832] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:33.755826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:33.779573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 422/833] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:33.799743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c781-5fd3-4243-b418-7bbf7f94670b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.800315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c781-5fd3-4243-b418-7bbf7f94670b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.800772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c781-5fd3-4243-b418-7bbf7f94670b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.802671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 423/834] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:33.810211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca282-12c9-4825-8a6c-961727ef4942 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.810498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca282-12c9-4825-8a6c-961727ef4942 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.810776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca282-12c9-4825-8a6c-961727ef4942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.818728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:33.830115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9bdca282-12c9-4825-8a6c-961727ef4942 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:33.831729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9bdca282-12c9-4825-8a6c-961727ef4942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:33.834749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:33.885952 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e170478-d4f3-485a-bb6d-8aca0c3068d9 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:33.912973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 424/835] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:33.933715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:33.934388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:33.934667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:33.934939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:33.935727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=2029f59c77de4240a78dba6960735bde) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:33.936033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:33.937583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:33.944555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 412/836] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:33 2022] GET /identity/v3/role_assignments?user.id=2029f59c77de4240a78dba6960735bde&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=41491b52194f43e2902307fb86036726 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:34.059936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdca282-12c9-4825-8a6c-961727ef4942 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.187682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdca282-12c9-4825-8a6c-961727ef4942 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:34.196515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.221168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:34.226714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195b8bd-3166-4e55-a7b7-720248535fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:34.227534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b8bd-3166-4e55-a7b7-720248535fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:34.227870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b8bd-3166-4e55-a7b7-720248535fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:34.228210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b8bd-3166-4e55-a7b7-720248535fd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:34.240367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195b8bd-3166-4e55-a7b7-720248535fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-9195b8bd-3166-4e55-a7b7-720248535fd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:34.245698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:34.248039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:34.250151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 425/837] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:34.256972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195b8bd-3166-4e55-a7b7-720248535fd6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.305137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6bccf-cc54-47ba-a5cf-8c630f41246d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:34.336025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:34.342716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9216298-ac6d-4d97-9a85-a880457e3440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:34.343508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216298-ac6d-4d97-9a85-a880457e3440 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:34.343722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216298-ac6d-4d97-9a85-a880457e3440 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:34.344000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216298-ac6d-4d97-9a85-a880457e3440 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:34.356896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9216298-ac6d-4d97-9a85-a880457e3440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-e9216298-ac6d-4d97-9a85-a880457e3440 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:34.362225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:34.363387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:12:34.364376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:34.368297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 413/838] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:34.370050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9216298-ac6d-4d97-9a85-a880457e3440 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.373859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195b8bd-3166-4e55-a7b7-720248535fd6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:34.412237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:34.413156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:34.413608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:34.414030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:34.414861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:34.415409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:34.417462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:34.432448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 426/839] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:34.433798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.501583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9216298-ac6d-4d97-9a85-a880457e3440 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:34.506743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:34.566692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:34.567797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:34.568156 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:34.568502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:34.569435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:34.570034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:34.572898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:34.597482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 414/840] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:34.604171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f1158-830c-4d2b-afee-eff31488b3b9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:34.605459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.648372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:34.649323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:34.649766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:34.650752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:34.663450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:34.665283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:34.668150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:34.682820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:34.690545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:34.691939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:34.691939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:34.691939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:34.692244 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 427/841] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:34.694049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.721303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86322d53-b48d-444a-a6df-87fc4b1ed2d4 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:34.758875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:34.760177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:34.760529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:34.760870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:34.773203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:34.774828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:34.791248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:34.792676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:34.794064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:34.794064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:34.794064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:34.798387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 415/842] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:34.799466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.832474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6874-3461-44f6-b3da-98cec0cef398 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:34.851621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:34.897525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:34.898578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:34.899070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:34.899547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:34.901102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:34.901678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:34.904280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:34.926529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 428/843] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:34.927721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:34.930044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5ad9b-537c-474b-a108-6ef97db1ff1f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:34.934394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:34.976136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:34.977140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:34.977678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:34.978632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:34.979455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:34.979916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:34.981658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:34.997336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 416/844] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:35.006019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:35.066237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19f08-8aee-4bf8-8184-7f5a6d8ee504 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:35.115754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:35.116387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.117223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.117505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.128092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:35.129584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:35.143653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd32a1-9bfb-41fa-b9fa-192c47361487 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:35.147594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:35.148743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:12:35.150720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:35.156983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 429/845] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:12:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:35.157208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:35.194112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:35.198570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:35.199897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.200450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.200907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.210396 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:35.212262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:35.227448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:35.228524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:35.229620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:35.233045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 417/846] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:12:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:35.237919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:35.274225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:35.302957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88170e-6938-42a7-aa67-32ead7cdf205 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:35.349827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:35.351233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.351815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.352310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.354419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:35.355170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:35.356706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56156ff0-2a7e-4d47-a9f6-c775d5451a06 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:35.357053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:35.390037 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 430/847] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Sep 5 12:12:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:35.392153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:35.399324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9bbb5-889d-49d9-9101-d3b5a701616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:35.401133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bbb5-889d-49d9-9101-d3b5a701616d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.401521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bbb5-889d-49d9-9101-d3b5a701616d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.401900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bbb5-889d-49d9-9101-d3b5a701616d None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.402736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bbb5-889d-49d9-9101-d3b5a701616d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:35.403142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bbb5-889d-49d9-9101-d3b5a701616d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:35.404912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bbb5-889d-49d9-9101-d3b5a701616d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:35.425522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 418/848] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Sep 5 12:12:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:35.427079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7b801-b09f-43ca-8c51-6a9f416b9974 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.427507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7b801-b09f-43ca-8c51-6a9f416b9974 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.427907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7b801-b09f-43ca-8c51-6a9f416b9974 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.429523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 419/849] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:35.430437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7b801-b09f-43ca-8c51-6a9f416b9974 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:35.491354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:35.513008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f76e23-f7af-43c6-8490-ab5455fc2995 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:35.523078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:35.543389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7b801-b09f-43ca-8c51-6a9f416b9974 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:35.553350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcbfe6-f775-48d6-95a1-6dac9a4bfe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:35.553966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcbfe6-f775-48d6-95a1-6dac9a4bfe5d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.554245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcbfe6-f775-48d6-95a1-6dac9a4bfe5d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.554515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcbfe6-f775-48d6-95a1-6dac9a4bfe5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.581832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fab8e-3b7a-46fc-a8a7-77e26e0f9a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:35.582428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fab8e-3b7a-46fc-a8a7-77e26e0f9a19 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.582711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fab8e-3b7a-46fc-a8a7-77e26e0f9a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.582981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fab8e-3b7a-46fc-a8a7-77e26e0f9a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.630552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcbfe6-f775-48d6-95a1-6dac9a4bfe5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:35.632111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcbfe6-f775-48d6-95a1-6dac9a4bfe5d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:35.654667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fab8e-3b7a-46fc-a8a7-77e26e0f9a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:35.656035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fab8e-3b7a-46fc-a8a7-77e26e0f9a19 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:35.728789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:35.746777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:35.747087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 431/850] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:35.748397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54164c-a523-49a1-897b-40dfae7e604b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.748687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54164c-a523-49a1-897b-40dfae7e604b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.748988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54164c-a523-49a1-897b-40dfae7e604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.768710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2e54164c-a523-49a1-897b-40dfae7e604b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:35.770099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2e54164c-a523-49a1-897b-40dfae7e604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:35.773234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 420/851] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:35.775549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fab8e-3b7a-46fc-a8a7-77e26e0f9a19 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:35.857190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 432/852] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:35.857190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54164c-a523-49a1-897b-40dfae7e604b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:35.904162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fab8e-3b7a-46fc-a8a7-77e26e0f9a19 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:35.943480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:35.944350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:35.944898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:35.945360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:35.957848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:35.959655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:35.961498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54164c-a523-49a1-897b-40dfae7e604b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:35.976710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:35.977852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:35.978984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:35.980061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:35.980061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:35.980061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:35.985881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 421/853] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:35.987458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.011919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.013372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.013870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.014528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.031376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.033345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.035100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:36.055912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:36.057062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:36.057993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:36.057993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:36.057993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:36.060416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 433/854] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:36.068369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.115793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb180a1-05a8-410e-a3f2-dc4b89037ec1 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.155688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a94ce-562b-4bf4-a563-822bc77585ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.156299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a94ce-562b-4bf4-a563-822bc77585ff None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.156575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a94ce-562b-4bf4-a563-822bc77585ff None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.156847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a94ce-562b-4bf4-a563-822bc77585ff None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.157743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a94ce-562b-4bf4-a563-822bc77585ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:36.157870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a94ce-562b-4bf4-a563-822bc77585ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.159183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a94ce-562b-4bf4-a563-822bc77585ff None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.173765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 422/855] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:36.175045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c71c3-296b-4c86-a95e-ef4e797c3aec None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.175324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c71c3-296b-4c86-a95e-ef4e797c3aec None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.175600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c71c3-296b-4c86-a95e-ef4e797c3aec None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.177033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 423/856] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:36.177872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c71c3-296b-4c86-a95e-ef4e797c3aec None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.183789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b498-59d6-43e2-98f8-850458d7af1c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.220917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.221545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.221741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.222011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.222656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:36.223122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.224566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.237493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 434/857] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:36.238345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.267670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:36.281983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:36.289784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c71c3-296b-4c86-a95e-ef4e797c3aec None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.324550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d28c0-5490-4165-864b-80e0677a274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.325210 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d28c0-5490-4165-864b-80e0677a274a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.325494 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d28c0-5490-4165-864b-80e0677a274a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.325768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d28c0-5490-4165-864b-80e0677a274a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.326350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d28c0-5490-4165-864b-80e0677a274a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.327771 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d28c0-5490-4165-864b-80e0677a274a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-f36d28c0-5490-4165-864b-80e0677a274a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:36.336640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:36.338416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:36.339334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 424/858] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:36.340154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab3344-6919-4ffb-8da7-0f84d58d82e3 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.340154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab3344-6919-4ffb-8da7-0f84d58d82e3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.340289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab3344-6919-4ffb-8da7-0f84d58d82e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.346005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b4348-8e42-400d-8677-d772f7a61850 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.358827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f5ab3344-6919-4ffb-8da7-0f84d58d82e3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:36.360034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f5ab3344-6919-4ffb-8da7-0f84d58d82e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:36.380829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.381505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.381790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.382084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.389120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.390596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:36.403365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:36.404488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 435/859] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:36.405771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.441131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 425/860] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:36.441131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab3344-6919-4ffb-8da7-0f84d58d82e3 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.519163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:36.540734 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66d392-a9d7-4814-ae80-6bfc18d7562f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.553211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:36.567695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab3344-6919-4ffb-8da7-0f84d58d82e3 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.578487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.579164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.579412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.579687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.586793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.588879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:36.600447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:36.601516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:36.602574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:36.602574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:36.602574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:36.602574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:36.602574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:36.602574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:36.602574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:36.602574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:36.606380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 436/861] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:36.607159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.607995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705909e-06a2-400c-b191-83a368724437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.608793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705909e-06a2-400c-b191-83a368724437 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.609252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705909e-06a2-400c-b191-83a368724437 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.609675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705909e-06a2-400c-b191-83a368724437 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.610651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705909e-06a2-400c-b191-83a368724437 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:36.611961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705909e-06a2-400c-b191-83a368724437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.613530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705909e-06a2-400c-b191-83a368724437 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.623311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 426/862] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:36.623311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705909e-06a2-400c-b191-83a368724437 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.729957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705909e-06a2-400c-b191-83a368724437 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.732068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a5c51-d1a5-42b3-909a-f697140ccf1a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.765446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.766037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.766317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.766588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.767160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.767333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:36.767640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.767779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.768019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.768288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.769012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:36.769326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.769464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.770723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.782212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 427/863] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:36.783039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.784711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 437/864] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:36.785421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.794706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:36.798887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:36.890970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8f960-6476-46ed-8705-dcfc7c5c9d4d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.893542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222cee3-82c4-4003-b6b9-96b0cbddad6b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:36.927539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.928145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.928423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.928692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.929354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:36.929663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.931027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.934480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:36.935105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:36.935388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:36.935647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 428/865] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:36.935775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:36.936239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:36.936422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:36.937637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:36.953859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:36.954914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:36.955856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 438/866] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:36.957894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:37.036472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:37.047291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:37.064302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab7b3f-cd5b-4171-a7b6-cb7aad8c641b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:37.084866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a8d7d-5bd4-442c-8b2e-2f9c09f96dd3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:37.105235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:37.105938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:37.106117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:37.106387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:37.107118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=939c785e259f445a97c737152ae96a6e) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:37.107423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:37.108975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:37.117155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 429/867] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/role_assignments?user.id=939c785e259f445a97c737152ae96a6e&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=41491b52194f43e2902307fb86036726 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:37.117976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:37.131955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:37.132742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:37.133258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:37.133535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:37.134503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=7160f78808c54480acff300737dcb15c) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:37.134819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:37.136365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:37.144447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 439/868] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:36 2022] GET /identity/v3/role_assignments?user.id=7160f78808c54480acff300737dcb15c&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:37.256836 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58945c-2018-4d67-ba7a-87154ba60e22 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:37.310591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d2f47-3a3c-4a13-be28-fbad7a13ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:37.311210 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d2f47-3a3c-4a13-be28-fbad7a13ff80 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:37.311409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d2f47-3a3c-4a13-be28-fbad7a13ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:37.311681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d2f47-3a3c-4a13-be28-fbad7a13ff80 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:37.312331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d2f47-3a3c-4a13-be28-fbad7a13ff80 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:37.312637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d2f47-3a3c-4a13-be28-fbad7a13ff80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:37.314110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d2f47-3a3c-4a13-be28-fbad7a13ff80 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:37.320727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 430/869] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:37.327668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:37.510282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf0d74-4aee-49fb-85ae-03c16363beb0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:37.551077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b0f69-b9d2-4621-9542-0d39ab4b1ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:37.551695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0f69-b9d2-4621-9542-0d39ab4b1ede None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:37.551975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0f69-b9d2-4621-9542-0d39ab4b1ede None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:37.552316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0f69-b9d2-4621-9542-0d39ab4b1ede None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:37.553139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b0f69-b9d2-4621-9542-0d39ab4b1ede None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:37.553444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b0f69-b9d2-4621-9542-0d39ab4b1ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:37.554965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b0f69-b9d2-4621-9542-0d39ab4b1ede None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:37.556973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:37.561805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 440/870] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:39.130809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8af8f4-8b46-49ae-a8ff-9dcaa9ee2e73 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.131354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8af8f4-8b46-49ae-a8ff-9dcaa9ee2e73 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.131354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8af8f4-8b46-49ae-a8ff-9dcaa9ee2e73 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.133008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 431/871] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:39.138717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a622d0-23f9-4e0d-80d3-20c57322713a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.139197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a622d0-23f9-4e0d-80d3-20c57322713a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.139275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a622d0-23f9-4e0d-80d3-20c57322713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.159560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f8a622d0-23f9-4e0d-80d3-20c57322713a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:39.160776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f8a622d0-23f9-4e0d-80d3-20c57322713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:39.270877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 441/872] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:39.296580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99adeb-7722-410d-828b-b55afdf65240 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.296925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99adeb-7722-410d-828b-b55afdf65240 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.297171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99adeb-7722-410d-828b-b55afdf65240 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.298797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 432/873] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:39.305713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ca1eb-fc91-4ca4-8f3e-dfbdeaddb0d4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.306216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ca1eb-fc91-4ca4-8f3e-dfbdeaddb0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.306712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ca1eb-fc91-4ca4-8f3e-dfbdeaddb0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.318538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9854-48a3-4708-bbfe-4b48bbdeceb6 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.319173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9854-48a3-4708-bbfe-4b48bbdeceb6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.319690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f9854-48a3-4708-bbfe-4b48bbdeceb6 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.321534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 433/874] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:39.327255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b2ee-8231-4d62-a529-af5cf0e5d956 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.327852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b2ee-8231-4d62-a529-af5cf0e5d956 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.328440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b2ee-8231-4d62-a529-af5cf0e5d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.329122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0d5ca1eb-fc91-4ca4-8f3e-dfbdeaddb0d4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:39.330332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0d5ca1eb-fc91-4ca4-8f3e-dfbdeaddb0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:39.337861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:39.350811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a365b2ee-8231-4d62-a529-af5cf0e5d956 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:39.352339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a365b2ee-8231-4d62-a529-af5cf0e5d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:39.409848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 442/875] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:39.428893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 434/876] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:39.590769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ca1eb-fc91-4ca4-8f3e-dfbdeaddb0d4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:39.609465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e991-6034-4638-8103-609f826d8b81 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.609782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e991-6034-4638-8103-609f826d8b81 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.610030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e991-6034-4638-8103-609f826d8b81 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.611669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 435/877] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:39.617168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bb2c2-53f8-405b-ad7f-4e679f02865e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.617454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bb2c2-53f8-405b-ad7f-4e679f02865e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.617731 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bb2c2-53f8-405b-ad7f-4e679f02865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.638628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a49bb2c2-53f8-405b-ad7f-4e679f02865e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:39.640184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a49bb2c2-53f8-405b-ad7f-4e679f02865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:39.657537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:39.703216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ca1eb-fc91-4ca4-8f3e-dfbdeaddb0d4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:39.733038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 436/878] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:39.736077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bb2c2-53f8-405b-ad7f-4e679f02865e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:39.754054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484d89-34b8-4e3b-80e4-059972152ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:39.755161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484d89-34b8-4e3b-80e4-059972152ca2 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.755609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484d89-34b8-4e3b-80e4-059972152ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.756080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484d89-34b8-4e3b-80e4-059972152ca2 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.757458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc484d89-34b8-4e3b-80e4-059972152ca2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:39.760682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc484d89-34b8-4e3b-80e4-059972152ca2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:39.815568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:39.839518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 443/879] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:12:39 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:39.840276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484d89-34b8-4e3b-80e4-059972152ca2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:39.872357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bb2c2-53f8-405b-ad7f-4e679f02865e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:39.940554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:39.941730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:39.942359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:39.942970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:39.944130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:39.947410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:39.964925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:39.966867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:39.968465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:39.973686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 437/880] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:39.977894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:40.080644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484d89-34b8-4e3b-80e4-059972152ca2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:40.105075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:40.124761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180f810-1fe7-4fb0-a347-22e88a766c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:40.125480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f810-1fe7-4fb0-a347-22e88a766c5e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:40.125728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f810-1fe7-4fb0-a347-22e88a766c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:40.126000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f810-1fe7-4fb0-a347-22e88a766c5e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:40.142540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180f810-1fe7-4fb0-a347-22e88a766c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:40.147959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c008ea-c6bf-4270-b161-933d7fda2645 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0180f810-1fe7-4fb0-a347-22e88a766c5e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:40.148750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:40.150864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 444/881] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Sep 5 12:12:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:40.151974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180f810-1fe7-4fb0-a347-22e88a766c5e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:40.181556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:40.192883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:40.193526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:40.193807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:40.194077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:40.194722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:40.195022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:40.196450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:40.208725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 438/882] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:40.208725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:40.286468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180f810-1fe7-4fb0-a347-22e88a766c5e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:40.327217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84eb6e-a55f-4535-88a1-1bf585e583dc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:40.347941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28ac9f-1fc3-45ad-9ac6-c9228c300a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:40.349094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28ac9f-1fc3-45ad-9ac6-c9228c300a1c None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:40.349383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28ac9f-1fc3-45ad-9ac6-c9228c300a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:40.349657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28ac9f-1fc3-45ad-9ac6-c9228c300a1c None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:40.350330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28ac9f-1fc3-45ad-9ac6-c9228c300a1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:40.352334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28ac9f-1fc3-45ad-9ac6-c9228c300a1c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:40.374132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:40.374809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:40.375186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:40.375533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:40.377385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:40.377385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:40.378714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:40.388631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 439/883] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Sep 5 12:12:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:40.389518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:40.443791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:40.465201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 445/884] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:12:40 2022] POST /identity/v3/services => generated 269 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:40.465201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28ac9f-1fc3-45ad-9ac6-c9228c300a1c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:40.530708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:40.532847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006f8c-1770-4878-8f06-5d480af60f1d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:40.586768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:40.587286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:40.587576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:40.587886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:40.588965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:40.588965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:40.590262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:40.596013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 440/885] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:40.613627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28ac9f-1fc3-45ad-9ac6-c9228c300a1c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:40.670061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:40.671066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:40.671510 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:40.671928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:40.685945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:40.687858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:40.706090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:40.707345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:40.708534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:40.708534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:40.708534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:40.710423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 446/886] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:40.716837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:40.829993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83f7e1-7140-4b23-a20a-f215e301383a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:40.845346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:40.866329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:40.869487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:40.869487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:40.869487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:40.869487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:40.869487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:40.870582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:40.885634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 441/887] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:40.891387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:41.007280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:41.017992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc237c-2c66-4be6-ba91-fd17d8848962 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:41.055040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:41.055682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:41.055971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:41.056272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:41.065236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:41.066723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:41.080384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:41.081443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:41.082371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 447/888] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:12:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:41.089987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:41.201296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2fe66-8847-40cb-bf6c-411e26d41bb8 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:41.239229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:41.240181 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:41.241097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:41.241097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:41.242119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:41.242621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:41.244855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:41.264754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 442/889] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Sep 5 12:12:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:41.270770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:41.407326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e2f57-3b6a-455d-bb8a-3fcc8fe32089 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:41.442490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00930-e702-42c0-857c-75f70cf8b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:41.443109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00930-e702-42c0-857c-75f70cf8b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:41.443390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00930-e702-42c0-857c-75f70cf8b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:41.443664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00930-e702-42c0-857c-75f70cf8b2b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:41.464384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:41.517382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf00930-e702-42c0-857c-75f70cf8b2b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:41.518849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf00930-e702-42c0-857c-75f70cf8b2b7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:41.631921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 448/890] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:41 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:41.638620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:41.685754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:41.765549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743570b1-8d20-4156-a1fb-99b92b87e348 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:41.806128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f8ad6-2343-4a7f-879b-ecec706f305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:41.807959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f8ad6-2343-4a7f-879b-ecec706f305c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:41.808572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f8ad6-2343-4a7f-879b-ecec706f305c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:41.809220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f8ad6-2343-4a7f-879b-ecec706f305c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:41.826746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f8ad6-2343-4a7f-879b-ecec706f305c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:41.828461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f8ad6-2343-4a7f-879b-ecec706f305c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-0e1f8ad6-2343-4a7f-879b-ecec706f305c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:41.846581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:41.847828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:41.849155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:41.849155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:41.849155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:41.852969 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 443/891] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:41.855764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00930-e702-42c0-857c-75f70cf8b2b7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:41.915211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:41.958287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63ac2-ccf3-49d6-b651-55630d6603a5 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:41.958930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63ac2-ccf3-49d6-b651-55630d6603a5 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:41.959393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc63ac2-ccf3-49d6-b651-55630d6603a5 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:41.961110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 444/892] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:41.967166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f082-dc49-4d10-9d0b-048b1db34a08 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:41.967464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f082-dc49-4d10-9d0b-048b1db34a08 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:41.967713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800f082-dc49-4d10-9d0b-048b1db34a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:41.974038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00930-e702-42c0-857c-75f70cf8b2b7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:41.987695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7800f082-dc49-4d10-9d0b-048b1db34a08 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:41.988890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7800f082-dc49-4d10-9d0b-048b1db34a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:42.013109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:42.013723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.014005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.014275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.014930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:42.015339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:42.016866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:42.031834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 449/893] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:42.040545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:42.080983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 445/894] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:42.156894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3de0ce-b7a3-470d-97d9-0bb050ac5ca2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:42.168938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:42.193104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:42.193740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.194021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.194292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.201777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:42.203741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:42.217525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:42.218477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:42.219363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 450/895] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:42.230301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800f082-dc49-4d10-9d0b-048b1db34a08 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:42.244549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:42.344549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800f082-dc49-4d10-9d0b-048b1db34a08 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:42.371817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:42.384522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:42.385719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.386221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.386758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.387811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:42.388339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:42.390078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:42.405666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 446/896] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:42.412048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:42.488634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b1a67-fa8a-4587-86da-d6cda22de764 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:42.495232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:42.527299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:42.528001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.528284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.528559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.529190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:42.530585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:42.534647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de15edb-28f0-45ca-a54c-3f91e574b9f8 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:42.540316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:42.541990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:42.542846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:42.547520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 451/897] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:42.549029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:42.580195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10026a17-5575-4696-b5e8-d2d95236e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:42.581231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10026a17-5575-4696-b5e8-d2d95236e445 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.581515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10026a17-5575-4696-b5e8-d2d95236e445 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.582373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10026a17-5575-4696-b5e8-d2d95236e445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.582609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10026a17-5575-4696-b5e8-d2d95236e445 None admin] RBAC: Adding query filter params (role.id=9b23dfdf79d64f72a63fa7d088896eaf, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=7160f78808c54480acff300737dcb15c) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:42.582921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10026a17-5575-4696-b5e8-d2d95236e445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:42.584405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10026a17-5575-4696-b5e8-d2d95236e445 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:42.592550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:42.595602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 447/898] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:42 2022] GET /identity/v3/role_assignments?user.id=7160f78808c54480acff300737dcb15c&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=9b23dfdf79d64f72a63fa7d088896eaf => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:42.606196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9989-ca3f-44f2-abf8-d1741cbdaeb7 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.606196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9989-ca3f-44f2-abf8-d1741cbdaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.606196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9989-ca3f-44f2-abf8-d1741cbdaeb7 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.606196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 448/899] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:42.609495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bf42-722f-4923-87b3-eb9e8b276e88 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.609495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bf42-722f-4923-87b3-eb9e8b276e88 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.609918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322bf42-722f-4923-87b3-eb9e8b276e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.635318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e322bf42-722f-4923-87b3-eb9e8b276e88 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:42.637253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e322bf42-722f-4923-87b3-eb9e8b276e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:42.725141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcc979-6488-431d-b3f8-c0111a23456a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:42.749537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 449/900] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:42.783401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:42.784018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.784621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.784621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.785274 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:42.785569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:42.786949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:42.791683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb44bd-4389-4aab-95ff-ffcb3bafad89 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.791683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb44bd-4389-4aab-95ff-ffcb3bafad89 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.791942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb44bd-4389-4aab-95ff-ffcb3bafad89 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.793375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 452/901] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:42.797222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 450/902] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:42.799329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:42.805048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f104-6f01-4fc8-bbfc-f3453c21e782 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.805048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f104-6f01-4fc8-bbfc-f3453c21e782 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.805048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f104-6f01-4fc8-bbfc-f3453c21e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.824548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8fe3f104-6f01-4fc8-bbfc-f3453c21e782 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:42.825838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8fe3f104-6f01-4fc8-bbfc-f3453c21e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:42.931561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:42.941316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:42.943108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 451/903] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:42.948311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26670c97-601c-4098-9c35-ef71437c0403 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:42.995150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:42.996203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:42.996706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:42.997221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:42.998226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:42.998808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:43.000455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:43.012243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 453/904] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:43.014075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3f104-6f01-4fc8-bbfc-f3453c21e782 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:43.042962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:43.162113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ea1a9-9b24-4d3d-9920-70530ae42003 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:43.166167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3f104-6f01-4fc8-bbfc-f3453c21e782 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:43.201593 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:43.202257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:43.202607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:43.202952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:43.203619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:43.205347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:43.210707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:43.211623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:43.212087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:43.213182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:43.214221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] RBAC: Adding query filter params (interface=public, service_id=428ae7d56b224676ae9cabda4d085055, region_id=RegionOne) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:43.214729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:43.216044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:43.216971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:43.223185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 454/905] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Sep 5 12:12:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:43.223984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:43.224411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:43.232592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 452/906] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Sep 5 12:12:43 2022] GET /identity/v3/endpoints?service_id=428ae7d56b224676ae9cabda4d085055&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:43.243035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:43.261626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:43.312726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:43.342923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e04ce-1595-4215-94fd-51af1db56865 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:43.358997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8a02b-e245-414a-9fec-c3c3559548c0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:43.383618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:43.384262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:43.384548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:43.385187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:43.385872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:43.386292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:43.387703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:43.393546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 455/907] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:43.394440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:43.400183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdae5ed-457f-4c9b-94a1-30716263fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:43.400810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae5ed-457f-4c9b-94a1-30716263fd92 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:43.401392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae5ed-457f-4c9b-94a1-30716263fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:43.401663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae5ed-457f-4c9b-94a1-30716263fd92 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:43.402277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdae5ed-457f-4c9b-94a1-30716263fd92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:43.403656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdae5ed-457f-4c9b-94a1-30716263fd92 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:43.410109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 453/908] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:12:43 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:12:43.410913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdae5ed-457f-4c9b-94a1-30716263fd92 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:43.528406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:43.543901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dcfd7-637c-46bc-b47c-e7e5198db069 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:43.559987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdae5ed-457f-4c9b-94a1-30716263fd92 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:43.594237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:43.599219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775e5ca-87bb-461f-bbbc-fae55c1383c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:43.599842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775e5ca-87bb-461f-bbbc-fae55c1383c1 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:43.600179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775e5ca-87bb-461f-bbbc-fae55c1383c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:43.600442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775e5ca-87bb-461f-bbbc-fae55c1383c1 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:43.602121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775e5ca-87bb-461f-bbbc-fae55c1383c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:43.602622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b775e5ca-87bb-461f-bbbc-fae55c1383c1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:43.609623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:43.614385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:43.614385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:43.614385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:43.614385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:43.614385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:43.614385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:43.619569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 454/909] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:43.625581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:43.694748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 456/910] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:12:43 2022] POST /identity/v3/services => generated 241 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:43.773472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6730ac-6592-453f-b99a-4f96f4fe0ed2 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:43.824177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff98477-997f-431b-ba79-3f149e2ff3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:43.824682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff98477-997f-431b-ba79-3f149e2ff3fa None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:43.824990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff98477-997f-431b-ba79-3f149e2ff3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:43.825263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff98477-997f-431b-ba79-3f149e2ff3fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:43.825960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff98477-997f-431b-ba79-3f149e2ff3fa None admin] RBAC: Adding query filter params (interface=public, service_id=7199173720af4f679be9e6e0c0c551d9, region_id=RegionOne) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:43.826267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff98477-997f-431b-ba79-3f149e2ff3fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:43.831361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff98477-997f-431b-ba79-3f149e2ff3fa None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:43.836984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 455/911] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Sep 5 12:12:43 2022] GET /identity/v3/endpoints?service_id=7199173720af4f679be9e6e0c0c551d9&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:43.839807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775e5ca-87bb-461f-bbbc-fae55c1383c1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:43.982602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b775e5ca-87bb-461f-bbbc-fae55c1383c1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:44.030419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792b98e-2216-4af6-b687-7288c2d43f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:44.031399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b98e-2216-4af6-b687-7288c2d43f27 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:44.031878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b98e-2216-4af6-b687-7288c2d43f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:44.032374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b98e-2216-4af6-b687-7288c2d43f27 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:44.033265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792b98e-2216-4af6-b687-7288c2d43f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:44.034820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792b98e-2216-4af6-b687-7288c2d43f27 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:44.042248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 457/912] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:12:43 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:12:44.660441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324cd0-46b3-4df3-9f3f-5943e8076a85 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:44.660998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324cd0-46b3-4df3-9f3f-5943e8076a85 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:44.661080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324cd0-46b3-4df3-9f3f-5943e8076a85 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:44.662621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 456/913] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:44.668053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cc310-ff1a-4d1f-9196-49a75b9e4ff8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:44.668483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cc310-ff1a-4d1f-9196-49a75b9e4ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:44.668657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cc310-ff1a-4d1f-9196-49a75b9e4ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:44.690436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-330cc310-ff1a-4d1f-9196-49a75b9e4ff8 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:44.691705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-330cc310-ff1a-4d1f-9196-49a75b9e4ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:44.703753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:44.765723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 458/914] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:45.049637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324cd0-46b3-4df3-9f3f-5943e8076a85 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:45.113006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:45.180743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324cd0-46b3-4df3-9f3f-5943e8076a85 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:45.217713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842692c2-5951-4a53-afb4-7fb7a2890644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:45.218703 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842692c2-5951-4a53-afb4-7fb7a2890644 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.219182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842692c2-5951-4a53-afb4-7fb7a2890644 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.219649 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842692c2-5951-4a53-afb4-7fb7a2890644 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.231034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842692c2-5951-4a53-afb4-7fb7a2890644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-842692c2-5951-4a53-afb4-7fb7a2890644 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:45.236137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:45.237128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:12:45.237991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:45.240380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 457/915] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Sep 5 12:12:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:45.249002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cc310-ff1a-4d1f-9196-49a75b9e4ff8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:45.358071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cc310-ff1a-4d1f-9196-49a75b9e4ff8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:45.392970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb839b-4c3c-4daa-ac65-97f5496f9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:45.393582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb839b-4c3c-4daa-ac65-97f5496f9c3e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.393861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb839b-4c3c-4daa-ac65-97f5496f9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.394132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb839b-4c3c-4daa-ac65-97f5496f9c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.394798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb839b-4c3c-4daa-ac65-97f5496f9c3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:45.395113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb839b-4c3c-4daa-ac65-97f5496f9c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:45.396454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb839b-4c3c-4daa-ac65-97f5496f9c3e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:45.405787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 459/916] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Sep 5 12:12:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:45.411159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842692c2-5951-4a53-afb4-7fb7a2890644 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:45.481409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb6d4-9c37-401b-a04e-737e4ae47dca None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.481859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb6d4-9c37-401b-a04e-737e4ae47dca None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.482223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb6d4-9c37-401b-a04e-737e4ae47dca None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.487297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 460/917] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:45.488889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314d0dc-e827-4f20-9692-38ae334f756f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.489287 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314d0dc-e827-4f20-9692-38ae334f756f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.489634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314d0dc-e827-4f20-9692-38ae334f756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.508124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:45.509888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2314d0dc-e827-4f20-9692-38ae334f756f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:45.511191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2314d0dc-e827-4f20-9692-38ae334f756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:45.524222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842692c2-5951-4a53-afb4-7fb7a2890644 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:45.533494 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:45.562025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:45.562655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.562983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.563254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.574609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:45.576355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:45.593709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:45.594726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:45.596134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:45.596134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:45.596134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:45.596134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 458/918] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:45.603125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:45.603295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 461/919] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:45.717246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83524a-e7e3-4f13-831b-897f72b41a07 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:45.752596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f375d-7355-477d-8545-edf55e5abbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:45.753229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f375d-7355-477d-8545-edf55e5abbfe None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.753508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f375d-7355-477d-8545-edf55e5abbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.753773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f375d-7355-477d-8545-edf55e5abbfe None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.754416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f375d-7355-477d-8545-edf55e5abbfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:45.754719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f375d-7355-477d-8545-edf55e5abbfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:45.756078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f375d-7355-477d-8545-edf55e5abbfe None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:45.770011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 459/920] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:45.778064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314d0dc-e827-4f20-9692-38ae334f756f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:45.886719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314d0dc-e827-4f20-9692-38ae334f756f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:45.903670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1356f-8815-49e5-b895-c0f68b49cb03 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.903950 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1356f-8815-49e5-b895-c0f68b49cb03 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.904219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1356f-8815-49e5-b895-c0f68b49cb03 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.905870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 460/921] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:45.911226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3a46-e75c-4efd-a981-2e645ab6c103 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.911506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3a46-e75c-4efd-a981-2e645ab6c103 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.911787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3a46-e75c-4efd-a981-2e645ab6c103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.927297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:45.927829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:45.928117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:45.928388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:45.932232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:45.932516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f24c3a46-e75c-4efd-a981-2e645ab6c103 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:45.933746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f24c3a46-e75c-4efd-a981-2e645ab6c103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:45.937701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:45.939150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:45.948146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:45.951935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:45.957357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 462/922] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:12:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:45.958409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.011258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 461/923] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:46.012736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c3a46-e75c-4efd-a981-2e645ab6c103 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.064570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18421cc0-a27f-431d-b895-b89e5a0e58ae None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.099930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1601b5-69ee-4658-8de6-fd6481e7a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.100556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1601b5-69ee-4658-8de6-fd6481e7a776 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.100839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1601b5-69ee-4658-8de6-fd6481e7a776 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.101144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1601b5-69ee-4658-8de6-fd6481e7a776 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.101730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1601b5-69ee-4658-8de6-fd6481e7a776 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.103158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1601b5-69ee-4658-8de6-fd6481e7a776 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-fb1601b5-69ee-4658-8de6-fd6481e7a776 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:46.111942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:46.113123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:46.114365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 463/924] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:46.119586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b09b6-8f43-4fe2-9779-784597cabbe0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.119874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b09b6-8f43-4fe2-9779-784597cabbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.120150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b09b6-8f43-4fe2-9779-784597cabbe0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.122077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 464/925] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:46.122624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b09b6-8f43-4fe2-9779-784597cabbe0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.153386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c3a46-e75c-4efd-a981-2e645ab6c103 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.188874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:46.193421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f50df-4627-42f1-acf3-f81f008b3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.194037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f50df-4627-42f1-acf3-f81f008b3af7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.194345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f50df-4627-42f1-acf3-f81f008b3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.194622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f50df-4627-42f1-acf3-f81f008b3af7 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.195384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f50df-4627-42f1-acf3-f81f008b3af7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:46.195690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f50df-4627-42f1-acf3-f81f008b3af7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.197840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f50df-4627-42f1-acf3-f81f008b3af7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.220993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 462/926] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:46.220993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bdfd4-4999-4b3c-9a3f-a96540852371 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.220993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bdfd4-4999-4b3c-9a3f-a96540852371 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.220993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bdfd4-4999-4b3c-9a3f-a96540852371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.233077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:46.239964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-975bdfd4-4999-4b3c-9a3f-a96540852371 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:46.241219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-975bdfd4-4999-4b3c-9a3f-a96540852371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:46.245701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b09b6-8f43-4fe2-9779-784597cabbe0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.288469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.289025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.289311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.289585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.290764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:46.291061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.292479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.297719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 465/927] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:46.298561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.322863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 463/928] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:46.322863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bdfd4-4999-4b3c-9a3f-a96540852371 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.415806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd415d-6558-4bd6-88b1-0f1b4db80fcb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.430130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bdfd4-4999-4b3c-9a3f-a96540852371 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.441396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:46.453084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.456042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.456042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.456042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.464594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.466080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.469073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.469896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.470336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.470817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.471545 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.473080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.476199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:46.481897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:46.482849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:46.490298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:46.490298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:46.490298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:46.490298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 466/929] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:46.490565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:46.491696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:46.492743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:46.493861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.493957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 464/930] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:46.493957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.597560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320ec31-885a-4db6-a05e-d5f2e4d85ca9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.607735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf691233-7fa7-450a-87e5-d4b411adde48 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.633465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.634103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.634385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.634662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.635296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:46.635598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.636982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.641318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.641747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 467/931] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:46.641917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.642194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.642462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.642574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.643171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:46.643474 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.644834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.658787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 465/932] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:46.659667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.686517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:46.723869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:46.749496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3a549-95d5-457c-8b63-8a418cd52feb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.769343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6762f-3ec0-43dd-ac13-e5caf4dbd931 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.784109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.784722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.785010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.785291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.785931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:46.786236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.787607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.792233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 468/933] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:46.793017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.808000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.808634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.808912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.809244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.809829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.811180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:46.820071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:46.821205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:46.822697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 466/934] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:46.823519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:46.901572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68c4e6-7a77-4cb2-b957-b8eb9a7bfe21 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.903792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:46.924780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20045a5-5ec5-4333-a6fa-d5cdb9313209 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:46.935448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ece5c-3a4f-4394-be9f-6a6fec528e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.936061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ece5c-3a4f-4394-be9f-6a6fec528e51 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.936349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ece5c-3a4f-4394-be9f-6a6fec528e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.936619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ece5c-3a4f-4394-be9f-6a6fec528e51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.937323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ece5c-3a4f-4394-be9f-6a6fec528e51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.938691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ece5c-3a4f-4394-be9f-6a6fec528e51 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.948713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:46.959943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:46.960576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:46.960858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:46.964323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:46.967969 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:46.969435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:46.980968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:46.981914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 467/935] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:46.982876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:47.014907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 469/936] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:12:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:47.015777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ece5c-3a4f-4394-be9f-6a6fec528e51 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:47.103770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964246f-05a3-49e3-89c4-ddaec01d3ee0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:47.149279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ece5c-3a4f-4394-be9f-6a6fec528e51 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:47.150871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:47.151844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:47.152025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:47.152302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:47.152939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:47.153939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:47.154662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:47.165860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 468/937] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:47.165860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:47.195152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:47.196190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:47.196190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:47.196388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:47.197127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:47.197428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:47.198798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:47.208660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 470/938] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:47.208660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:47.223066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:47.229978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:47.278729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02061b5-4ea3-4302-bba4-eca0554aedce None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:47.319926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f576f-6c4e-46ee-9b07-e7f46240d89a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:47.320994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:47.321869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:47.322151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:47.323330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:47.323991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:47.324301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:47.325894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:47.347257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 469/939] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:47.347257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:47.358725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:47.359367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:47.359623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:47.359901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:47.360613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] RBAC: Adding query filter params (interface=public, service_id=b168f791d71d46349acc1fc33aca7524, region_id=RegionOne) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:47.360929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:47.362324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:47.367661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 471/940] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Sep 5 12:12:47 2022] GET /identity/v3/endpoints?service_id=b168f791d71d46349acc1fc33aca7524&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:47.369002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:47.464087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:47.480295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6929-2556-4fe9-b0dc-e97a66eafa54 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:47.497099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a602ff-3160-46ba-a0fe-5e84a05443c6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:47.500252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:47.521430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc190dc-ba05-4bf8-91b5-b24e340b34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:47.522104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc190dc-ba05-4bf8-91b5-b24e340b34fb None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:47.522385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc190dc-ba05-4bf8-91b5-b24e340b34fb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:47.522664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc190dc-ba05-4bf8-91b5-b24e340b34fb None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/7160f78808c54480acff300737dcb15c/roles/9b23dfdf79d64f72a63fa7d088896eaf` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:47.525471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc190dc-ba05-4bf8-91b5-b24e340b34fb None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=7160f78808c54480acff300737dcb15c, role_id=9b23dfdf79d64f72a63fa7d088896eaf)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:47.527358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc190dc-ba05-4bf8-91b5-b24e340b34fb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:47.547863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:47.548484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:47.548767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:47.549076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:47.549723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:47.550125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:47.551485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:47.556996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 470/941] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:47.557840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:47.611804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 472/942] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:12:47 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/7160f78808c54480acff300737dcb15c/roles/9b23dfdf79d64f72a63fa7d088896eaf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:12:47.612802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc190dc-ba05-4bf8-91b5-b24e340b34fb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:47.704089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8142dc-8428-4add-8649-fa0d75d2b38d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:47.747076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5e8ac-8301-48d4-b8cc-6fda5272ba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:47.748429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e8ac-8301-48d4-b8cc-6fda5272ba03 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:47.748711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e8ac-8301-48d4-b8cc-6fda5272ba03 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:47.749003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e8ac-8301-48d4-b8cc-6fda5272ba03 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:47.749635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5e8ac-8301-48d4-b8cc-6fda5272ba03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:47.751101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5e8ac-8301-48d4-b8cc-6fda5272ba03 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:47.752738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc190dc-ba05-4bf8-91b5-b24e340b34fb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:47.760195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 471/943] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:12:47 2022] GET /identity/v3/services => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:12:47.801856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097450bd-93bc-4a4b-abc2-c030a890e56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:47.802534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097450bd-93bc-4a4b-abc2-c030a890e56c None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:47.802744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097450bd-93bc-4a4b-abc2-c030a890e56c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:47.803012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097450bd-93bc-4a4b-abc2-c030a890e56c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:47.803688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097450bd-93bc-4a4b-abc2-c030a890e56c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:47.805097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097450bd-93bc-4a4b-abc2-c030a890e56c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:47.908724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:47.914621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 473/944] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:12:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:49.026104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efa716-1423-4784-806c-8ecd402ddb9c None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.026902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efa716-1423-4784-806c-8ecd402ddb9c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.026902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efa716-1423-4784-806c-8ecd402ddb9c None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.028482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 472/945] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:49.033721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66120-392a-413e-b10c-dfc58881be1b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.034134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66120-392a-413e-b10c-dfc58881be1b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.034305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66120-392a-413e-b10c-dfc58881be1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.053478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-76e66120-392a-413e-b10c-dfc58881be1b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:49.054649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-76e66120-392a-413e-b10c-dfc58881be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:49.137921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 474/946] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:49.412370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efa716-1423-4784-806c-8ecd402ddb9c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:49.445901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:49.520575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efa716-1423-4784-806c-8ecd402ddb9c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:49.557389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:49.558057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.558346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.558625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.559277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:49.560718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:49.563388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING keystone.server.flask.common [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 05 12:12:49.609175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.sql.core [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 12:12:49.609175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 12:12:49.609175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [parameters: {'id': 'a8a4594b4f2e44bc8a4fe2eb7afea8e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 12:12:49.609175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81685) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a8a4594b4f2e44bc8a4fe2eb7afea8e9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a8a4594b4f2e44bc8a4fe2eb7afea8e9. Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:12:49.617074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application result.read() Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 05 12:12:49.617911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application yield resource Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise self.value Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application session.commit() Sep 05 12:12:49.619438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.session.flush() Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application compat.raise_( Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 12:12:49.621627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 12:12:49.623707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application result.read() Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:12:49.624726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [parameters: {'id': 'a8a4594b4f2e44bc8a4fe2eb7afea8e9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:49.626601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:49.627806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a8a4594b4f2e44bc8a4fe2eb7afea8e9. Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:49.628895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 473/947] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Sep 5 12:12:49 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:49.633547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8c45-3ab4-4735-9cda-6219033f262f None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.633547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8c45-3ab4-4735-9cda-6219033f262f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.633547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8c45-3ab4-4735-9cda-6219033f262f None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.633733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:49.633811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 475/948] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:49.633811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4ce8f-f26b-4671-adc5-3f764ee56328 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.633811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4ce8f-f26b-4671-adc5-3f764ee56328 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.633811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4ce8f-f26b-4671-adc5-3f764ee56328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.657717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-04a4ce8f-f26b-4671-adc5-3f764ee56328 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:49.659099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-04a4ce8f-f26b-4671-adc5-3f764ee56328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:49.749340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 476/949] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:49.751199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ee240-864f-409d-9d11-153fc12416cc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:49.777444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:49.789581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:49.790597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.791015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.791431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.792672 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad65f-f927-4d3d-995f-bf065a47b6ba None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.793104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad65f-f927-4d3d-995f-bf065a47b6ba None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.793507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad65f-f927-4d3d-995f-bf065a47b6ba None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.798820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 477/950] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:49.799446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:49.800340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5012-d0b3-4c35-991c-c00da89537af None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.800692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5012-d0b3-4c35-991c-c00da89537af None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.801069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c5012-d0b3-4c35-991c-c00da89537af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.801778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:49.816553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:49.817727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:49.818811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:49.818811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:49.818811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:49.818811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:49.818811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:49.818811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:49.818811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:49.818811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:49.822611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 474/951] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:49.828099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2e9c5012-d0b3-4c35-991c-c00da89537af None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:49.828099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2e9c5012-d0b3-4c35-991c-c00da89537af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:49.832710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:49.887644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:49.913158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 478/952] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:49.939827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c7513-73fb-4ac9-8642-91e939927acb None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.940112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c7513-73fb-4ac9-8642-91e939927acb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.940392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c7513-73fb-4ac9-8642-91e939927acb None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.942058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 479/953] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:49.948647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d463a44-6e03-42cb-9bc2-4a7674733090 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:49.948929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d463a44-6e03-42cb-9bc2-4a7674733090 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:49.949235 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d463a44-6e03-42cb-9bc2-4a7674733090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:49.966269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc07e0-23b0-47f4-a731-cd98f974eb78 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:49.973076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8d463a44-6e03-42cb-9bc2-4a7674733090 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:49.974900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8d463a44-6e03-42cb-9bc2-4a7674733090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:50.013221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.014096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.014743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.015281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.016101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:50.016554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.019169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.049311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 475/954] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:50.050190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.070799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:50.077382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 480/955] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:50.178298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa4620-ae8f-4347-a097-4a8725a8a086 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.189902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d463a44-6e03-42cb-9bc2-4a7674733090 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.224027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17d8c-bd56-4dd4-b25f-7c680859e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.224786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17d8c-bd56-4dd4-b25f-7c680859e460 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.225107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17d8c-bd56-4dd4-b25f-7c680859e460 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.225382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17d8c-bd56-4dd4-b25f-7c680859e460 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.237457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c17d8c-bd56-4dd4-b25f-7c680859e460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-36c17d8c-bd56-4dd4-b25f-7c680859e460 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:12:50.243927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:50.244929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:50.245968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 476/956] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:50.251167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17d8c-bd56-4dd4-b25f-7c680859e460 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.321609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d463a44-6e03-42cb-9bc2-4a7674733090 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.348350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:50.351504 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:50.370263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.370899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.371180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.371458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.372044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.373476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:50.383396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:50.386007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:50.386868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 481/957] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:50.387783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.389501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17d8c-bd56-4dd4-b25f-7c680859e460 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.430903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.431566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.431850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.432173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.432899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:50.433241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.434667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.443085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 477/958] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:50.444172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.503194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b95a7-c60e-4bee-b1bc-825e50eedd3b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.539406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.540042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.540359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.540635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.541259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.542628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:50.551606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:50.552639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:50.553558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 482/959] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:50.554385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.561341 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5129eb2-9e54-48dd-871b-e51203e83ba3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.591351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:50.597559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.598398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.602148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.602148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.602148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:50.602148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.602148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.608731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:50.612183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 478/960] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:50.613191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.673539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48187040-c875-4aac-bf7d-e297d76b909c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.711469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.712295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.712892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.713203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.718335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed26291-b7ac-469b-9bac-3fe9ad8df964 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.725704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.727461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:50.744531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:50.745708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:50.746627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:50.746627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:50.746627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:50.746627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 483/961] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:50.746627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.766260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.767301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.767587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.768028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.768663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:50.769005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.770394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.784979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 479/962] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:50.784979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.852704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:50.861744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:50.867884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641c0f9-0c1a-46fe-a491-d53c74720dd3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.907045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479cf2-5f97-420b-a096-72f72cc4b5b6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:50.910091 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.910987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.911554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.912023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.913093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:50.913402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.914778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.920753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 484/963] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:50.921900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:50.952256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:50.952863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:50.953181 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:50.953460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:50.954111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:50.954421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:50.955793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:50.967967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 480/964] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:50.968758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:51.032408 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae9571-61b7-469e-8350-7db48b800392 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:51.069905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:51.070526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:51.070813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:51.071087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:51.071767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:51.072071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:51.073483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:51.079168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 485/965] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:51.080071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:51.093458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59632-2c3e-46ce-ae13-b5978d140fc0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:51.111956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:51.126487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:51.152109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04338b40-44fd-4f68-9dbe-ae247d91a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:51.152546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04338b40-44fd-4f68-9dbe-ae247d91a946 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:51.152841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04338b40-44fd-4f68-9dbe-ae247d91a946 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:51.153169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04338b40-44fd-4f68-9dbe-ae247d91a946 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:51.153888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04338b40-44fd-4f68-9dbe-ae247d91a946 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:51.155313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04338b40-44fd-4f68-9dbe-ae247d91a946 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:51.220579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97ce8-c94f-45f7-a2ad-f94589ed2777 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:51.233546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 481/966] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:12:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:51.274391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:51.275925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:51.276452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:51.276727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:51.285540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:51.287025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:51.301469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:51.302578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:51.303553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 486/967] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:12:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:51.310867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04338b40-44fd-4f68-9dbe-ae247d91a946 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:51.424018 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04338b40-44fd-4f68-9dbe-ae247d91a946 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:51.458694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:51.459359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:51.459640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:51.459908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:51.460698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:51.461029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:51.463212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:51.482558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 482/968] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Sep 5 12:12:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:51.488186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:51.577305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:51.598374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b028f0e-ab6f-44da-9891-5e90dee74b62 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:51.635267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7418c-d7a9-494a-a534-883a9d8c31bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:51.635940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7418c-d7a9-494a-a534-883a9d8c31bf None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:51.636465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7418c-d7a9-494a-a534-883a9d8c31bf None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:51.636743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7418c-d7a9-494a-a534-883a9d8c31bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:51.708138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7418c-d7a9-494a-a534-883a9d8c31bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:51.709527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7418c-d7a9-494a-a534-883a9d8c31bf None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:51.793313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:51.813986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 487/969] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:12:51 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:12:51.819746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:51.853950 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:51.933450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcd608-7968-4940-8d42-0839724687fa None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:51.969264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe902b-432c-4a98-9c33-f0dafec8ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:51.969815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe902b-432c-4a98-9c33-f0dafec8ea62 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:51.970092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe902b-432c-4a98-9c33-f0dafec8ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:51.970360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe902b-432c-4a98-9c33-f0dafec8ea62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:51.981882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe902b-432c-4a98-9c33-f0dafec8ea62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:51.983347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe902b-432c-4a98-9c33-f0dafec8ea62 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-5fbe902b-432c-4a98-9c33-f0dafec8ea62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:12:51.998895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:51.999910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:12:52.000828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:12:52.000828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:12:52.000828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:52.000828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 483/970] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:52.005843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7418c-d7a9-494a-a534-883a9d8c31bf None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:52.109464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc94e38-8d05-472a-b882-f0aa4997b52f None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:52.110477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc94e38-8d05-472a-b882-f0aa4997b52f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:52.110990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc94e38-8d05-472a-b882-f0aa4997b52f None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:52.112520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 484/971] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:52.115179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7418c-d7a9-494a-a534-883a9d8c31bf None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:52.117928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea703d-b13c-44b4-9a4e-a655612a9c3c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:52.118237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea703d-b13c-44b4-9a4e-a655612a9c3c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:52.118522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea703d-b13c-44b4-9a4e-a655612a9c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:52.141128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1eea703d-b13c-44b4-9a4e-a655612a9c3c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:52.142963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1eea703d-b13c-44b4-9a4e-a655612a9c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:52.158339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:52.159523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:52.160056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:52.160766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:52.162150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:52.162958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:52.165216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:52.180988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 488/972] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:52.185010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:52.243203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 485/973] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:52.270739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:52.308447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefd497-823e-4300-af35-7a75430a8eca None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:52.349953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:52.350991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:52.351491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:52.351992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:52.362691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:52.364363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:12:52.377713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:52.378696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:52.380005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 489/974] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:52.385246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea703d-b13c-44b4-9a4e-a655612a9c3c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:52.402910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:52.497338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea703d-b13c-44b4-9a4e-a655612a9c3c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:52.533125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:52.533741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:52.534031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:52.534304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:52.535002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:52.535309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:52.536750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:52.545259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:52.548888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 486/975] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:52.556394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:52.640130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:52.666487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7154fba-8c25-4b3f-92cb-d4dddab96557 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:52.685669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:52.689996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd687ca-b8ac-4227-9b94-8abf9197376c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:52.703731 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:52.704345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:52.704676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:52.704978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:52.705742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] RBAC: Adding query filter params (role.id=9b23dfdf79d64f72a63fa7d088896eaf, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=7160f78808c54480acff300737dcb15c) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:52.706013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:52.707461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:52.721423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 487/976] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:12:52 2022] GET /identity/v3/role_assignments?user.id=7160f78808c54480acff300737dcb15c&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=9b23dfdf79d64f72a63fa7d088896eaf => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:52.740362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:52.741028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:52.741379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:52.741659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:52.742384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:52.744422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:52.747262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING keystone.server.flask.common [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 05 12:12:52.786215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.sql.core [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 12:12:52.786215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 12:12:52.786215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [parameters: {'user_id': 'a0dc06351af24ba6bb50801df767bbaf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 12:12:52.786215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81686) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result.read() Sep 05 12:12:52.804406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:12:52.806293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application yield resource Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise self.value Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application session.commit() Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 12:12:52.807272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.session.flush() Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application compat.raise_( Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 12:12:52.808184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:12:52.809120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result.read() Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:12:52.810653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a0dc06351af24ba6bb50801df767bbaf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:52.811697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 05 12:12:52.812492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 05 12:12:52.821167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 05 12:12:52.821167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 05 12:12:52.821167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 12:12:52.821167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 12:12:52.821167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 12:12:52.821167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:52.821167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 490/977] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Sep 5 12:12:52 2022] POST /identity/v3/users => generated 160 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:52.829837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:52.946989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33c38b-f9e3-4d64-b77c-7fed2f3d7357 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:52.984024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca7683-5d65-47aa-a01f-abbc89a3b0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:52.984721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7683-5d65-47aa-a01f-abbc89a3b0eb None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:52.985033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7683-5d65-47aa-a01f-abbc89a3b0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:52.985307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca7683-5d65-47aa-a01f-abbc89a3b0eb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:52.994300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7683-5d65-47aa-a01f-abbc89a3b0eb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:52.995855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca7683-5d65-47aa-a01f-abbc89a3b0eb None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:52.997991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-44ca7683-5d65-47aa-a01f-abbc89a3b0eb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:12:53.008701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:53.009775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:53.010768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 488/978] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:12:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:53.016207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:53.125244 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad2db5-b314-4318-8343-7182cebde01d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:53.162003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9474e2-885e-43a3-a391-56ab45ad4a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:53.162990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9474e2-885e-43a3-a391-56ab45ad4a91 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:53.163508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9474e2-885e-43a3-a391-56ab45ad4a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:53.164004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9474e2-885e-43a3-a391-56ab45ad4a91 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:53.164913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9474e2-885e-43a3-a391-56ab45ad4a91 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:53.165978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9474e2-885e-43a3-a391-56ab45ad4a91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:53.167847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9474e2-885e-43a3-a391-56ab45ad4a91 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:53.183529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa346b-acb3-4f3a-bc0f-b285be255f54 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:53.184075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa346b-acb3-4f3a-bc0f-b285be255f54 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:53.184075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa346b-acb3-4f3a-bc0f-b285be255f54 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:53.186683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 489/979] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:53.190809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9013cf5-6852-4e48-a90c-0925d732509d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:53.191096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9013cf5-6852-4e48-a90c-0925d732509d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:53.191421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9013cf5-6852-4e48-a90c-0925d732509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:53.210055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c9013cf5-6852-4e48-a90c-0925d732509d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:53.211248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c9013cf5-6852-4e48-a90c-0925d732509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:53.215842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 491/980] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Sep 5 12:12:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:53.301737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 490/981] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:53.303719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e65b-8049-4c74-9d2a-ada95b3f75a5 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:53.304120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e65b-8049-4c74-9d2a-ada95b3f75a5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:53.304511 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e65b-8049-4c74-9d2a-ada95b3f75a5 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:53.306926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 492/982] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:53.312603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd1cc-2a0f-4af1-b354-47c8647701e9 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:53.312927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd1cc-2a0f-4af1-b354-47c8647701e9 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:53.313217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd1cc-2a0f-4af1-b354-47c8647701e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:53.333009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-437fd1cc-2a0f-4af1-b354-47c8647701e9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:53.334257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-437fd1cc-2a0f-4af1-b354-47c8647701e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:53.409848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 491/983] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:53.574588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e65b-8049-4c74-9d2a-ada95b3f75a5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:53.597761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:53.678498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd1cc-2a0f-4af1-b354-47c8647701e9 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:53.685717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e65b-8049-4c74-9d2a-ada95b3f75a5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:53.721855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63633335-43fe-4662-a6f4-bd1b1d16d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:53.722466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63633335-43fe-4662-a6f4-bd1b1d16d00c None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:53.722750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63633335-43fe-4662-a6f4-bd1b1d16d00c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:53.723041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63633335-43fe-4662-a6f4-bd1b1d16d00c None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:53.723681 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63633335-43fe-4662-a6f4-bd1b1d16d00c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:53.725076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63633335-43fe-4662-a6f4-bd1b1d16d00c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:53.740728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:53.783921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd1cc-2a0f-4af1-b354-47c8647701e9 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:53.795363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 493/984] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:12:53 2022] POST /identity/v3/services => generated 242 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:53.844620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:53.845300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:53.845579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:53.845900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:53.846486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:53.847895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:53.858803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:53.860705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:53.861734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:53.863238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 492/985] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:53.867041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63633335-43fe-4662-a6f4-bd1b1d16d00c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:53.975709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:53.996450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63633335-43fe-4662-a6f4-bd1b1d16d00c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:54.032333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:54.037922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:54.037922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:54.037922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:54.037922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:54.037922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:54.037922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:54.041459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 494/986] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:54.047272 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:54.171036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f40c5-9d06-4b06-af60-13413f8d47b5 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:54.189652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:54.210032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:54.211079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:54.211587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:54.212577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:54.213721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:54.214286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:54.216826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:54.229092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 493/987] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:54.233576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:54.356891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a21e47-6ff8-44b3-b5c6-03b34c5ebdef None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:54.398273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edf8e6-9244-4fcf-8aca-b25dee83ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:54.399156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf8e6-9244-4fcf-8aca-b25dee83ea5e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:54.400032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf8e6-9244-4fcf-8aca-b25dee83ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:54.400368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf8e6-9244-4fcf-8aca-b25dee83ea5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:54.401217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edf8e6-9244-4fcf-8aca-b25dee83ea5e None admin] RBAC: Adding query filter params (interface=admin, service_id=b168f791d71d46349acc1fc33aca7524, region_id=RegionOne) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:54.401995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edf8e6-9244-4fcf-8aca-b25dee83ea5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:54.404336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edf8e6-9244-4fcf-8aca-b25dee83ea5e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:54.416761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 495/988] 10.222.0.39 () {56 vars in 1249 bytes} [Mon Sep 5 12:12:54 2022] GET /identity/v3/endpoints?service_id=b168f791d71d46349acc1fc33aca7524&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:54.427505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:54.542537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914550c6-05e6-4d9a-b445-1c0de80419db None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:54.576658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29e251-fca5-472c-b67b-fbcc3eccfdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:54.577299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e251-fca5-472c-b67b-fbcc3eccfdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:54.577580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e251-fca5-472c-b67b-fbcc3eccfdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:54.577848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e251-fca5-472c-b67b-fbcc3eccfdf7 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:54.578450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29e251-fca5-472c-b67b-fbcc3eccfdf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:54.579806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29e251-fca5-472c-b67b-fbcc3eccfdf7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:54.586361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 494/989] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:12:54 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:12:54.812390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947144f-e852-4f73-b672-de1e8dcc2f28 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:54.812738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947144f-e852-4f73-b672-de1e8dcc2f28 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:54.812861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947144f-e852-4f73-b672-de1e8dcc2f28 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:54.814428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 496/990] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:54.819896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cc0d-0a51-4e10-b9ad-0c407367992e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:54.820183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cc0d-0a51-4e10-b9ad-0c407367992e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:54.820463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cc0d-0a51-4e10-b9ad-0c407367992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:54.850235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-96b9cc0d-0a51-4e10-b9ad-0c407367992e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:54.851820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-96b9cc0d-0a51-4e10-b9ad-0c407367992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:54.927394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:54.973021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 495/991] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:55.258928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947144f-e852-4f73-b672-de1e8dcc2f28 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:55.271281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:55.372784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947144f-e852-4f73-b672-de1e8dcc2f28 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:55.420678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:55.421343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:55.421622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:55.421906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] PATH_INFO: `/v3/services/image` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:55.422484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:55.423955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:55.434869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:55.435965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:12:55.436834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:55.441130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 497/992] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Sep 5 12:12:55 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:55.441960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9cc0d-0a51-4e10-b9ad-0c407367992e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:55.549103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9cc0d-0a51-4e10-b9ad-0c407367992e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:55.583220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0b3b3-240c-412f-9e5e-27df0c9f6f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:55.583837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b3b3-240c-412f-9e5e-27df0c9f6f19 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:55.584119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b3b3-240c-412f-9e5e-27df0c9f6f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:55.584436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0b3b3-240c-412f-9e5e-27df0c9f6f19 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:55.585063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b3b3-240c-412f-9e5e-27df0c9f6f19 None admin] RBAC: Adding query filter params (name=image) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:55.585374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b3b3-240c-412f-9e5e-27df0c9f6f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:55.586741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0b3b3-240c-412f-9e5e-27df0c9f6f19 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:55.592587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 496/993] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:55.598165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:55.674193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:55.709623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afffe1-a4e9-47aa-98b2-2a3be46a7076 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:55.748463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fce31-a364-4c20-bdcb-77ce2ac28b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:55.749109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fce31-a364-4c20-bdcb-77ce2ac28b6c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:55.749390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fce31-a364-4c20-bdcb-77ce2ac28b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:55.749669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fce31-a364-4c20-bdcb-77ce2ac28b6c None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:55.750304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fce31-a364-4c20-bdcb-77ce2ac28b6c None admin] RBAC: Adding query filter params (type=image) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:55.750611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fce31-a364-4c20-bdcb-77ce2ac28b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:55.751975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fce31-a364-4c20-bdcb-77ce2ac28b6c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:55.756800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 498/994] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:12:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:55.764783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b7a6-18cc-45ee-94a6-0d3f799bd23e None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:55.765204 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b7a6-18cc-45ee-94a6-0d3f799bd23e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:55.765533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958b7a6-18cc-45ee-94a6-0d3f799bd23e None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:55.767222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 497/995] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:55.773666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656a4e-989f-42c4-924f-ef5a04697496 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:55.774000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656a4e-989f-42c4-924f-ef5a04697496 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:55.774485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24656a4e-989f-42c4-924f-ef5a04697496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:55.795651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-24656a4e-989f-42c4-924f-ef5a04697496 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:55.797976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-24656a4e-989f-42c4-924f-ef5a04697496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:55.891821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 499/996] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:56.160234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b7a6-18cc-45ee-94a6-0d3f799bd23e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:56.211889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:56.273440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958b7a6-18cc-45ee-94a6-0d3f799bd23e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:56.316708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea702224-686b-4880-ac07-d333807d306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:56.317381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea702224-686b-4880-ac07-d333807d306b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:56.317665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea702224-686b-4880-ac07-d333807d306b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:56.317942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea702224-686b-4880-ac07-d333807d306b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:56.318536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea702224-686b-4880-ac07-d333807d306b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:56.319914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea702224-686b-4880-ac07-d333807d306b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ea702224-686b-4880-ac07-d333807d306b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:56.329823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:56.330936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:56.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:56.333504 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 498/997] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:12:56.337067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656a4e-989f-42c4-924f-ef5a04697496 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:56.410512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:56.453678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24656a4e-989f-42c4-924f-ef5a04697496 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:56.490527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735f6ee-970d-4c06-b819-4cd14485b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:56.491130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f6ee-970d-4c06-b819-4cd14485b40f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:56.491409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f6ee-970d-4c06-b819-4cd14485b40f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:56.491733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f6ee-970d-4c06-b819-4cd14485b40f None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:56.492307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735f6ee-970d-4c06-b819-4cd14485b40f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:56.492609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735f6ee-970d-4c06-b819-4cd14485b40f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:56.494586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735f6ee-970d-4c06-b819-4cd14485b40f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:56.504486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 500/998] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:56.505480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea702224-686b-4880-ac07-d333807d306b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:56.565946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc69aa-7eae-43f8-af06-3b5db39e5128 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:56.566276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc69aa-7eae-43f8-af06-3b5db39e5128 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:56.566500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc69aa-7eae-43f8-af06-3b5db39e5128 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:56.567962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 501/999] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:56.573443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9769a-8be5-4909-b61a-a36e796747c1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:56.573729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9769a-8be5-4909-b61a-a36e796747c1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:56.574007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9769a-8be5-4909-b61a-a36e796747c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:56.595872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3aa9769a-8be5-4909-b61a-a36e796747c1 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:56.597095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3aa9769a-8be5-4909-b61a-a36e796747c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:56.617338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea702224-686b-4880-ac07-d333807d306b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:56.620239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:56.653059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:56.653694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:56.653974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:56.654247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:56.654873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:56.655175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:56.656531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:56.661286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 499/1000] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:12:56.667043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:56.672977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 502/1001] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:56.769125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c82324-15ce-429f-9e53-c7de7414ee6b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:56.803987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:56.804597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:56.804879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:56.805176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:56.806577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] RBAC: Adding query filter params (interface=public, service_id=a4a83ff3517c432a90ae05a33fbaa232, region_id=RegionOne) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:56.806885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:56.808257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:56.819522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 500/1002] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Sep 5 12:12:56 2022] GET /identity/v3/endpoints?service_id=a4a83ff3517c432a90ae05a33fbaa232&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:56.819675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9769a-8be5-4909-b61a-a36e796747c1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:56.888719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:56.932025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9769a-8be5-4909-b61a-a36e796747c1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:56.951773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:56.968134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698e6b1-4f21-4b02-9fa5-dbf9ed382f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:56.968749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e6b1-4f21-4b02-9fa5-dbf9ed382f5c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:56.969073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e6b1-4f21-4b02-9fa5-dbf9ed382f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:56.969352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e6b1-4f21-4b02-9fa5-dbf9ed382f5c None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:56.969971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698e6b1-4f21-4b02-9fa5-dbf9ed382f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:56.971415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698e6b1-4f21-4b02-9fa5-dbf9ed382f5c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:56.984979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 503/1003] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:12:56 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:12:56.995822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:57.079664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fcb26-bedb-49fd-a215-7735b42e0dee None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:57.123472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:57.123472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:57.123472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:57.123472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:57.123962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:57.124290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:57.135471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:57.136543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:12:57.137429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 501/1004] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Sep 5 12:12:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:57.142867 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698e6b1-4f21-4b02-9fa5-dbf9ed382f5c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:57.250752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698e6b1-4f21-4b02-9fa5-dbf9ed382f5c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:57.275724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:57.286936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:57.287551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:57.287829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:57.288102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:57.288733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:57.289066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:57.291192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:57.301055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 504/1005] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:57.302783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:57.403676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:57.410203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076861c3-c619-43a2-a2a7-1764d17c72d6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:57.445220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5ba72-5201-47b6-a87f-535e658fd6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:57.445844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ba72-5201-47b6-a87f-535e658fd6fc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:57.446125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ba72-5201-47b6-a87f-535e658fd6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:57.446398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5ba72-5201-47b6-a87f-535e658fd6fc None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:57.447040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5ba72-5201-47b6-a87f-535e658fd6fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:57.447345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5ba72-5201-47b6-a87f-535e658fd6fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:57.448734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5ba72-5201-47b6-a87f-535e658fd6fc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:57.454121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 502/1006] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Sep 5 12:12:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:57.460013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:57.563813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccd6fc-ec96-4cb6-aa4b-6704198dfcb2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:57.598453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469162-9acf-489e-8de0-4d24f870e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:57.599072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469162-9acf-489e-8de0-4d24f870e406 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:57.599351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469162-9acf-489e-8de0-4d24f870e406 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:57.599621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469162-9acf-489e-8de0-4d24f870e406 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:57.600305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469162-9acf-489e-8de0-4d24f870e406 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:57.601687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469162-9acf-489e-8de0-4d24f870e406 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:57.692404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 505/1007] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:12:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:57.694565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64037-7bc6-4352-ad9e-736850408b0c None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:57.695115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64037-7bc6-4352-ad9e-736850408b0c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:57.695326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64037-7bc6-4352-ad9e-736850408b0c None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:57.697502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 503/1008] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:57.703543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64263af5-9c9a-4e4f-8b62-8da512b6d309 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:57.703823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64263af5-9c9a-4e4f-8b62-8da512b6d309 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:57.704097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64263af5-9c9a-4e4f-8b62-8da512b6d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:57.724585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-64263af5-9c9a-4e4f-8b62-8da512b6d309 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:57.725884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-64263af5-9c9a-4e4f-8b62-8da512b6d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:57.777778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:57.812782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 506/1009] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:58.082802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b64037-7bc6-4352-ad9e-736850408b0c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:58.209034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b64037-7bc6-4352-ad9e-736850408b0c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:58.270442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfd2d9-daa4-49c4-9e5f-692c99423745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:58.271470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd2d9-daa4-49c4-9e5f-692c99423745 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:58.271955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd2d9-daa4-49c4-9e5f-692c99423745 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:58.272422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd2d9-daa4-49c4-9e5f-692c99423745 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:58.273628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfd2d9-daa4-49c4-9e5f-692c99423745 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:58.276941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfd2d9-daa4-49c4-9e5f-692c99423745 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:58.423882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 504/1010] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:12:58 2022] POST /identity/v3/services => generated 242 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:12:58.948139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef563-0e2a-42d1-801a-4ce5d5bc9d54 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:58.948710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef563-0e2a-42d1-801a-4ce5d5bc9d54 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:58.948710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ef563-0e2a-42d1-801a-4ce5d5bc9d54 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:58.950106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 507/1011] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:12:58.955880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf016ff-8f96-4f11-ad8b-007b69add07d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:58.956368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf016ff-8f96-4f11-ad8b-007b69add07d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:58.956456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf016ff-8f96-4f11-ad8b-007b69add07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:58.981458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-dcf016ff-8f96-4f11-ad8b-007b69add07d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:58.983568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-dcf016ff-8f96-4f11-ad8b-007b69add07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:59.005157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:59.073104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 505/1012] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:58 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:12:59.337441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ef563-0e2a-42d1-801a-4ce5d5bc9d54 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:59.498879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ef563-0e2a-42d1-801a-4ce5d5bc9d54 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:59.550843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:59.551512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:59.551967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:59.552380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:59.552999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:59.554584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:12:59.565008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:12:59.566713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:12:59.567609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 508/1013] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:12:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:12:59.573311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf016ff-8f96-4f11-ad8b-007b69add07d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:59.686109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf016ff-8f96-4f11-ad8b-007b69add07d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:59.748420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377180e-77b1-4c23-9e74-6f344f1957b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:59.749082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377180e-77b1-4c23-9e74-6f344f1957b6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:59.749369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377180e-77b1-4c23-9e74-6f344f1957b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:59.749646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377180e-77b1-4c23-9e74-6f344f1957b6 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:59.750307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377180e-77b1-4c23-9e74-6f344f1957b6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:59.750612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377180e-77b1-4c23-9e74-6f344f1957b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:59.752001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377180e-77b1-4c23-9e74-6f344f1957b6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:59.757885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 506/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:59.763691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:12:59.765777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320199c-fb57-4ece-9fb4-0f6e3c732b7a None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:59.766068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320199c-fb57-4ece-9fb4-0f6e3c732b7a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:59.766342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320199c-fb57-4ece-9fb4-0f6e3c732b7a None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:59.767808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 507/1015] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:12:59.773077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a33e-1369-405f-90da-8c914917771d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:59.773368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a33e-1369-405f-90da-8c914917771d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:59.773646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a33e-1369-405f-90da-8c914917771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:59.794560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a597a33e-1369-405f-90da-8c914917771d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:12:59.795783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a597a33e-1369-405f-90da-8c914917771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:12:59.800664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:59.824154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:59.901666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 508/1016] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:12:59 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:12:59.902592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869378da-42c2-479f-88b4-bf414066ed25 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:12:59.954590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:12:59.955986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:12:59.956432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:12:59.956858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:12:59.957699 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:12:59.958160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:12:59.959721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:12:59.966397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 509/1017] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Sep 5 12:12:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:12:59.972685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597a33e-1369-405f-90da-8c914917771d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:00.103521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597a33e-1369-405f-90da-8c914917771d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:00.145166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6d8c3-f816-4ca6-8b33-b9281742004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:00.145793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6d8c3-f816-4ca6-8b33-b9281742004f None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:00.146071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6d8c3-f816-4ca6-8b33-b9281742004f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:00.146337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6d8c3-f816-4ca6-8b33-b9281742004f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:00.147022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6d8c3-f816-4ca6-8b33-b9281742004f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:00.148436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6d8c3-f816-4ca6-8b33-b9281742004f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:00.160149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:00.192919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:00.252357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 509/1018] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:12:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:13:00.314440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380dd0d-459f-47fe-8100-28d2c7d0f174 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:00.316252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:00.364267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87308a-b6a4-4d39-84bc-2664b2645d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:00.364879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87308a-b6a4-4d39-84bc-2664b2645d8c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:00.365194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87308a-b6a4-4d39-84bc-2664b2645d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:00.365486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87308a-b6a4-4d39-84bc-2664b2645d8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:00.367652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87308a-b6a4-4d39-84bc-2664b2645d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:00.368203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87308a-b6a4-4d39-84bc-2664b2645d8c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:00.370226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 510/1019] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:00.376334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6d8c3-f816-4ca6-8b33-b9281742004f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:00.462508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dddba-411b-4f5b-b082-9bf456bfc243 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:00.463262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dddba-411b-4f5b-b082-9bf456bfc243 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:00.463717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dddba-411b-4f5b-b082-9bf456bfc243 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:00.466117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 511/1020] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:00.472935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1799a-0575-44f6-aa40-d7428ad73ca1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:00.473253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1799a-0575-44f6-aa40-d7428ad73ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:00.473709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1799a-0575-44f6-aa40-d7428ad73ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:00.497410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8bf1799a-0575-44f6-aa40-d7428ad73ca1 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:00.498648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8bf1799a-0575-44f6-aa40-d7428ad73ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:00.513063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6d8c3-f816-4ca6-8b33-b9281742004f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:00.572916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1493bc-24c2-4073-9ed9-70039a860b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:00.573621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1493bc-24c2-4073-9ed9-70039a860b2c None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:00.573902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1493bc-24c2-4073-9ed9-70039a860b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:00.574171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1493bc-24c2-4073-9ed9-70039a860b2c None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:00.574827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1493bc-24c2-4073-9ed9-70039a860b2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:00.576283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1493bc-24c2-4073-9ed9-70039a860b2c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:00.601906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 512/1021] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:00.641418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 510/1022] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:13:00 2022] POST /identity/v3/projects => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:00.877591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1799a-0575-44f6-aa40-d7428ad73ca1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:00.994996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:01.002947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1799a-0575-44f6-aa40-d7428ad73ca1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:01.039466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:01.040704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:01.041105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:01.041386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:01.042259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:01.043377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:01.053606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:01.054869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:13:01.056547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:01.059809 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 513/1023] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Sep 5 12:13:00 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:01.060828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1493bc-24c2-4073-9ed9-70039a860b2c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:01.119432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:01.177539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1493bc-24c2-4073-9ed9-70039a860b2c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:01.221248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:01.223793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:01.224086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:01.224360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:01.225034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:01.225344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:01.226747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:01.236771 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 511/1024] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:01.243521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:01.360231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8311e-689b-4999-a77b-2c0f3bf453a0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:01.399321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:01.399862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:01.400145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:01.400417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:01.401087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] RBAC: Adding query filter params (type=image) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:01.401394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:01.403019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:01.413017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 514/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:01.415723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:01.526863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2a4de-b19a-4ad8-abaf-93dca291e1f0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:01.543292 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:01.567657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c0dd6-1208-4b69-8c18-88bdab2ac937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:01.568515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c0dd6-1208-4b69-8c18-88bdab2ac937 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:01.568938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c0dd6-1208-4b69-8c18-88bdab2ac937 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:01.569407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c0dd6-1208-4b69-8c18-88bdab2ac937 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:01.570321 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c0dd6-1208-4b69-8c18-88bdab2ac937 None admin] RBAC: Adding query filter params (interface=public, service_id=bb17efb3a8b640d3a61a3ee803332bf9, region_id=RegionOne) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:01.570770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c0dd6-1208-4b69-8c18-88bdab2ac937 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:01.572344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c0dd6-1208-4b69-8c18-88bdab2ac937 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:01.583096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 512/1026] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Sep 5 12:13:01 2022] GET /identity/v3/endpoints?service_id=bb17efb3a8b640d3a61a3ee803332bf9&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:01.584657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:01.612928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:01.698047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a9a2-b301-4797-b8aa-833e9c147b69 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:01.740615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efd21d-b447-428b-a652-a85c6dc5e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:01.741288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd21d-b447-428b-a652-a85c6dc5e09e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:01.741623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd21d-b447-428b-a652-a85c6dc5e09e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:01.741846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd21d-b447-428b-a652-a85c6dc5e09e None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:01.742468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efd21d-b447-428b-a652-a85c6dc5e09e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:01.743920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efd21d-b447-428b-a652-a85c6dc5e09e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:01.751874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 515/1027] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:13:01 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:13:02.354048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eaabe-b764-461a-990f-8584cc0ea90f None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:02.354641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eaabe-b764-461a-990f-8584cc0ea90f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:02.354641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14eaabe-b764-461a-990f-8584cc0ea90f None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:02.355941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 513/1028] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:02.361413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44757e-d245-4989-bc52-3768c51c740d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:02.361885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44757e-d245-4989-bc52-3768c51c740d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:02.361992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44757e-d245-4989-bc52-3768c51c740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:02.381658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2a44757e-d245-4989-bc52-3768c51c740d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:02.382859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2a44757e-d245-4989-bc52-3768c51c740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:02.455570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 516/1029] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:02.679809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d4e5-97f9-4a2d-9371-f8fdc8050ca1 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:02.680170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d4e5-97f9-4a2d-9371-f8fdc8050ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:02.680275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d4e5-97f9-4a2d-9371-f8fdc8050ca1 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:02.681902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 514/1030] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:02.687094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a40d1-c71b-4ef3-8232-61d635c631ba None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:02.687388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a40d1-c71b-4ef3-8232-61d635c631ba None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:02.687668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a40d1-c71b-4ef3-8232-61d635c631ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:02.706756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6c5a40d1-c71b-4ef3-8232-61d635c631ba None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:02.707965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6c5a40d1-c71b-4ef3-8232-61d635c631ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:02.722849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:02.723313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951d4e5-97f9-4a2d-9371-f8fdc8050ca1 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:02.784656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 517/1031] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:02.849840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951d4e5-97f9-4a2d-9371-f8fdc8050ca1 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:02.906879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94761-f729-4331-bbb3-ef9e2da874b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:02.907525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94761-f729-4331-bbb3-ef9e2da874b7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:02.907823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94761-f729-4331-bbb3-ef9e2da874b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:02.908062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94761-f729-4331-bbb3-ef9e2da874b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:02.922349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea94761-f729-4331-bbb3-ef9e2da874b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-4ea94761-f729-4331-bbb3-ef9e2da874b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:02.931418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:02.933762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:13:02.935390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:02.938680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 515/1032] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Sep 5 12:13:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:13:02.940993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a40d1-c71b-4ef3-8232-61d635c631ba None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:03.051755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a40d1-c71b-4ef3-8232-61d635c631ba None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:03.066166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94761-f729-4331-bbb3-ef9e2da874b7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:03.089549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:03.090162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.090446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.090723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.091402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:03.091709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:03.093161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:03.101904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 518/1033] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Sep 5 12:13:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:03.107225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:03.112727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:03.121690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:03.182232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94761-f729-4331-bbb3-ef9e2da874b7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:03.216416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a103301-48e3-4e99-a6bf-4e841e53ccbe None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:03.220284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b966e5-a90b-499b-b6a0-fed7b412e2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:03.221244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b966e5-a90b-499b-b6a0-fed7b412e2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.221744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b966e5-a90b-499b-b6a0-fed7b412e2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.222246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b966e5-a90b-499b-b6a0-fed7b412e2c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.224283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b966e5-a90b-499b-b6a0-fed7b412e2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:03.226592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b966e5-a90b-499b-b6a0-fed7b412e2c6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:03.229372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 516/1034] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:03.235253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b966e5-a90b-499b-b6a0-fed7b412e2c6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:03.254647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:03.255295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.255579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.255924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.268346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:03.274983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:13:03.288073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:03.289163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:13:03.290744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:13:03.290744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:03.290744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:03.290744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 519/1035] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:03.295635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:03.357660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b966e5-a90b-499b-b6a0-fed7b412e2c6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:03.364143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:03.367394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:03.402088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d011-3eb6-4b61-88c0-3e34dd46fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:03.402744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d011-3eb6-4b61-88c0-3e34dd46fe0e None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.403020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d011-3eb6-4b61-88c0-3e34dd46fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.403349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64d011-3eb6-4b61-88c0-3e34dd46fe0e None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.404408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64d011-3eb6-4b61-88c0-3e34dd46fe0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:03.406714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64d011-3eb6-4b61-88c0-3e34dd46fe0e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:03.414257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c78a3-5373-407a-8e20-1cc43677b82e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:03.456962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:03.457526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.457806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.458075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.458750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:03.459106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:03.460485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:03.474201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 520/1036] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:03.480599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:03.518506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 517/1037] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:13:03 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:13:03.598701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520da7-1395-4bac-95e6-82a54ed45fbd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:03.628330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:03.642469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dbd8a-c710-4096-a5c8-ce10f8017822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:03.643223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dbd8a-c710-4096-a5c8-ce10f8017822 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.643568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dbd8a-c710-4096-a5c8-ce10f8017822 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.643906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dbd8a-c710-4096-a5c8-ce10f8017822 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.653592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dbd8a-c710-4096-a5c8-ce10f8017822 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:03.655254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dbd8a-c710-4096-a5c8-ce10f8017822 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-891dbd8a-c710-4096-a5c8-ce10f8017822 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:13:03.670637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:03.671845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:13:03.673024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:03.673686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 521/1038] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:13:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:13:03.677596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d011-3eb6-4b61-88c0-3e34dd46fe0e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:03.751079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186e3dc-8e4b-4a08-93f0-dad85cafa6a6 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.751380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186e3dc-8e4b-4a08-93f0-dad85cafa6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.751549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186e3dc-8e4b-4a08-93f0-dad85cafa6a6 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.752905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 522/1039] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:13:03.758228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26ab90-0e49-414e-bef7-256161efe3a4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.758516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26ab90-0e49-414e-bef7-256161efe3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.759376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26ab90-0e49-414e-bef7-256161efe3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.779826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cc26ab90-0e49-414e-bef7-256161efe3a4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:03.781064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cc26ab90-0e49-414e-bef7-256161efe3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:03.794074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64d011-3eb6-4b61-88c0-3e34dd46fe0e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:03.838841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:03.839458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:03.839740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:03.840009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:03.840740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:03.841073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:03.842536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:03.857076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 523/1040] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:03.869041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 518/1041] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:13:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:03.869222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26ab90-0e49-414e-bef7-256161efe3a4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:03.991940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26ab90-0e49-414e-bef7-256161efe3a4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.007120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:04.031128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630b30-8f0a-4409-939f-84f9ad6f5870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.032284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630b30-8f0a-4409-939f-84f9ad6f5870 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.032828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630b30-8f0a-4409-939f-84f9ad6f5870 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.033562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630b30-8f0a-4409-939f-84f9ad6f5870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.105382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62630b30-8f0a-4409-939f-84f9ad6f5870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.106832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62630b30-8f0a-4409-939f-84f9ad6f5870 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.125280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:04.147282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:04.231065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 524/1042] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:04.236861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630b30-8f0a-4409-939f-84f9ad6f5870 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:04.245294 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abec83-4d6a-420f-bbe1-cdf4b25f577f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.253168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:04.283177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.283723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.284004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.284279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] PATH_INFO: `/v3/services/image` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.284861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.286257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:04.296198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:04.297880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:04.299093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 519/1043] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Sep 5 12:13:04 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:13:04.303162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:04.351737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630b30-8f0a-4409-939f-84f9ad6f5870 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.390491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.391535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.391535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.391853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.402509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:04.403271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.404887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:13:04.422340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:04.430136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:13:04.432701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:13:04.432701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:04.432701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:04.432701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 525/1044] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:13:04.436565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80364be-c77a-4b98-a4cd-a1c9fad1c2fd None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.436793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:04.482070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.482785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.483069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.484050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.484050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:04.484380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.485844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.491263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 520/1045] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:04.497567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:04.514485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:04.556408 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6fda4-1f6f-40e1-96ce-32b3e33ae44e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.594012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.594790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.595208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.595590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.596343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:04.596762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.598294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.612588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 526/1046] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:04.615844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43bd75-3c7d-4090-a67d-5f00639e19c2 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.617776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:04.655667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.656276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.656560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.656835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.657502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] RBAC: Adding query filter params (type=image) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:04.657809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.659204 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.670077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 521/1047] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:04.671347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:04.684625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:04.735868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32237ea1-b78b-47cf-9664-ee63af6de632 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.764011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:04.776309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.777295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.777578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.777849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.779085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93481ab-29a3-489e-936d-48c7dd6a0c2d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.784774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.786251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:13:04.798557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:04.799484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:04.805216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 527/1048] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:04.805784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:04.823557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4c108-c5cc-4f25-8226-1857bb2a0ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.824104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4c108-c5cc-4f25-8226-1857bb2a0ea0 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.824546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4c108-c5cc-4f25-8226-1857bb2a0ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.824823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4c108-c5cc-4f25-8226-1857bb2a0ea0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.825644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4c108-c5cc-4f25-8226-1857bb2a0ea0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.829992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4c108-c5cc-4f25-8226-1857bb2a0ea0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.901942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 522/1049] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:13:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:04.920658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1d0d9-37bb-43c7-9143-f9a4294cd612 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:04.978256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e08e-dc14-4d74-b18f-4f7cdcee53f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:04.978873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e08e-dc14-4d74-b18f-4f7cdcee53f2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:04.979184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e08e-dc14-4d74-b18f-4f7cdcee53f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:04.979483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e08e-dc14-4d74-b18f-4f7cdcee53f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:04.980197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e08e-dc14-4d74-b18f-4f7cdcee53f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:04.980519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e08e-dc14-4d74-b18f-4f7cdcee53f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:04.982018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e08e-dc14-4d74-b18f-4f7cdcee53f2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:04.996721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 528/1050] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:05.002658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4c108-c5cc-4f25-8226-1857bb2a0ea0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:05.085098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:05.128750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4c108-c5cc-4f25-8226-1857bb2a0ea0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:05.167493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82156f-a310-40e5-be0b-c2291f8d067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:05.168103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82156f-a310-40e5-be0b-c2291f8d067a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:05.168383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82156f-a310-40e5-be0b-c2291f8d067a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:05.168650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82156f-a310-40e5-be0b-c2291f8d067a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:05.169410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82156f-a310-40e5-be0b-c2291f8d067a None admin] RBAC: Adding query filter params (role.id=9b23dfdf79d64f72a63fa7d088896eaf, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=2029f59c77de4240a78dba6960735bde) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:05.169714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82156f-a310-40e5-be0b-c2291f8d067a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:05.171159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82156f-a310-40e5-be0b-c2291f8d067a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:05.177680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 523/1051] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:05 2022] GET /identity/v3/role_assignments?user.id=2029f59c77de4240a78dba6960735bde&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=9b23dfdf79d64f72a63fa7d088896eaf => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:05.579604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f53b02-bf63-4a21-96d8-6ff12c4fb9f3 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:05.580185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f53b02-bf63-4a21-96d8-6ff12c4fb9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:05.580185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f53b02-bf63-4a21-96d8-6ff12c4fb9f3 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:05.581837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 529/1052] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:05.587385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a8d54-b0f6-47ea-bc25-2041e3f78903 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:05.588164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a8d54-b0f6-47ea-bc25-2041e3f78903 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:05.588164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a8d54-b0f6-47ea-bc25-2041e3f78903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:05.607350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-300a8d54-b0f6-47ea-bc25-2041e3f78903 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:05.608722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-300a8d54-b0f6-47ea-bc25-2041e3f78903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:05.681371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 524/1053] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:05.952971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f53b02-bf63-4a21-96d8-6ff12c4fb9f3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:05.999618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:06.066715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f53b02-bf63-4a21-96d8-6ff12c4fb9f3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:06.104050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58222d6-9715-4ef0-92ee-0133041b0cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:06.104690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58222d6-9715-4ef0-92ee-0133041b0cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:06.104986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58222d6-9715-4ef0-92ee-0133041b0cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:06.105263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58222d6-9715-4ef0-92ee-0133041b0cb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:06.116757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58222d6-9715-4ef0-92ee-0133041b0cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f58222d6-9715-4ef0-92ee-0133041b0cb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:06.122365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:06.123535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:06.124565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:06.131590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 530/1054] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:06.131741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a8d54-b0f6-47ea-bc25-2041e3f78903 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:06.195753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:06.241567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a8d54-b0f6-47ea-bc25-2041e3f78903 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:06.285345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:06.285961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:06.286248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:06.286519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:06.287200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:06.287505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:06.288923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:06.299659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 525/1055] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:13:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:06.306229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58222d6-9715-4ef0-92ee-0133041b0cb8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:06.437248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:06.440793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58222d6-9715-4ef0-92ee-0133041b0cb8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:06.488150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5a9fd-eb43-4809-8b22-f19bafb06e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:06.488851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a9fd-eb43-4809-8b22-f19bafb06e93 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:06.489170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a9fd-eb43-4809-8b22-f19bafb06e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:06.489453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a9fd-eb43-4809-8b22-f19bafb06e93 None admin] PATH_INFO: `/v3/users/99d066cdd42145e389dff9b8de6567f9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:06.506326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5a9fd-eb43-4809-8b22-f19bafb06e93 None admin] RBAC: Authorizing `identity:get_user(user_id=99d066cdd42145e389dff9b8de6567f9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:06.507807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5a9fd-eb43-4809-8b22-f19bafb06e93 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:06.510365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 531/1056] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:06 2022] GET /identity/v3/users/99d066cdd42145e389dff9b8de6567f9 => generated 285 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:06.517528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:06.672210 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba12e-1235-417a-9ba3-c11cb85667ee None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:06.702891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:06.722363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be77f3-6e5d-4e3f-8c15-37c86ba42854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:06.722997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be77f3-6e5d-4e3f-8c15-37c86ba42854 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:06.723280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be77f3-6e5d-4e3f-8c15-37c86ba42854 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:06.723639 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be77f3-6e5d-4e3f-8c15-37c86ba42854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:06.845971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be77f3-6e5d-4e3f-8c15-37c86ba42854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:06.847433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be77f3-6e5d-4e3f-8c15-37c86ba42854 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:06.955898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e562c9-bb94-45ef-9ac8-bb341a8835e5 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:06.956515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e562c9-bb94-45ef-9ac8-bb341a8835e5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:06.956515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e562c9-bb94-45ef-9ac8-bb341a8835e5 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:06.958002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 532/1057] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:13:06.965082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89340b2-df16-4dba-bb51-013d3f4ccfb9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:06.965613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89340b2-df16-4dba-bb51-013d3f4ccfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:06.966031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89340b2-df16-4dba-bb51-013d3f4ccfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:06.991155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b89340b2-df16-4dba-bb51-013d3f4ccfb9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:06.992429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b89340b2-df16-4dba-bb51-013d3f4ccfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:07.001000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 526/1058] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:07.002399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be77f3-6e5d-4e3f-8c15-37c86ba42854 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:07.039199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:07.097398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 533/1059] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:07.150510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be77f3-6e5d-4e3f-8c15-37c86ba42854 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:07.187114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7459f-f7ff-4d2e-a5a9-f2193376c6f0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:07.187411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7459f-f7ff-4d2e-a5a9-f2193376c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:07.187687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7459f-f7ff-4d2e-a5a9-f2193376c6f0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:07.189386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 534/1060] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:13:07.190322 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4c7ad-1201-4a4b-8ebe-ac454729eb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:07.190939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4c7ad-1201-4a4b-8ebe-ac454729eb21 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:07.191214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4c7ad-1201-4a4b-8ebe-ac454729eb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:07.191471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4c7ad-1201-4a4b-8ebe-ac454729eb21 None admin] PATH_INFO: `/v3/projects/32d823143a35468581ddc5b9fa5c41f7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:07.192657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4c7ad-1201-4a4b-8ebe-ac454729eb21 None admin] RBAC: Authorizing `identity:get_project(project_id=32d823143a35468581ddc5b9fa5c41f7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:07.194133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4c7ad-1201-4a4b-8ebe-ac454729eb21 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:07.194501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db399-0c04-4df2-aaab-5570e67830bc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:07.194788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db399-0c04-4df2-aaab-5570e67830bc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:07.195064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08db399-0c04-4df2-aaab-5570e67830bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:07.202019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 527/1061] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:07 2022] GET /identity/v3/projects/32d823143a35468581ddc5b9fa5c41f7 => generated 311 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:07.203187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4c7ad-1201-4a4b-8ebe-ac454729eb21 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:07.215076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b08db399-0c04-4df2-aaab-5570e67830bc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:07.216294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b08db399-0c04-4df2-aaab-5570e67830bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:07.305339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 535/1062] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:07.328537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:07.339400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4c7ad-1201-4a4b-8ebe-ac454729eb21 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:07.382052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:07.384232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:07.384232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:07.384232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:07.384517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08db399-0c04-4df2-aaab-5570e67830bc None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:07.384597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=32d823143a35468581ddc5b9fa5c41f7, user.id=99d066cdd42145e389dff9b8de6567f9) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:07.384597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:07.385762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:07.392763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 528/1063] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:07 2022] GET /identity/v3/role_assignments?user.id=99d066cdd42145e389dff9b8de6567f9&scope.project.id=32d823143a35468581ddc5b9fa5c41f7&role.id=41491b52194f43e2902307fb86036726 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:07.411094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:07.508508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08db399-0c04-4df2-aaab-5570e67830bc None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:07.551797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690bdd7-71f8-4e14-acde-0ad9f873c715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:07.552407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690bdd7-71f8-4e14-acde-0ad9f873c715 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:07.552684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690bdd7-71f8-4e14-acde-0ad9f873c715 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:07.552980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690bdd7-71f8-4e14-acde-0ad9f873c715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:07.576574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:07.632129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690bdd7-71f8-4e14-acde-0ad9f873c715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:07.634206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690bdd7-71f8-4e14-acde-0ad9f873c715 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:07.661483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:07.705422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cc54e-1e96-4f56-a5a5-95f1d9c38c8e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:07.751205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45402bf-e1c1-4b02-9508-95a9ca6ccf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:07.752114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45402bf-e1c1-4b02-9508-95a9ca6ccf07 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:07.752399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45402bf-e1c1-4b02-9508-95a9ca6ccf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:07.752663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45402bf-e1c1-4b02-9508-95a9ca6ccf07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:07.757511 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 536/1064] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:07.764035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690bdd7-71f8-4e14-acde-0ad9f873c715 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:07.765165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45402bf-e1c1-4b02-9508-95a9ca6ccf07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-d45402bf-e1c1-4b02-9508-95a9ca6ccf07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:07.771160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:07.772300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:13:07.773286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:07.775048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 529/1065] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Sep 5 12:13:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:13:07.778753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45402bf-e1c1-4b02-9508-95a9ca6ccf07 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:07.796492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:07.890923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690bdd7-71f8-4e14-acde-0ad9f873c715 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:07.893139 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45402bf-e1c1-4b02-9508-95a9ca6ccf07 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:07.915361 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:07.934425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:07.935040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:07.935319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:07.941112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:07.941252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:07.941352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:07.941447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:07.941447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:07.941611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:07.941703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:07.941788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:07.948589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:07.950099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:07.951352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 530/1066] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Sep 5 12:13:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:07.952265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:13:07.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:07.969339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:13:07.970538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:13:07.970538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:07.970538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:07.974180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 537/1067] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:13:07.976990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:08.041770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:08.068303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076580e-e50d-479c-815f-717a6bfd0d9a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:08.089502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19adaf1-e11b-45b3-8c64-da93fa478396 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:08.107850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:08.108479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:08.108756 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:08.109053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:08.120690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:08.122181 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:08.124427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:08.125087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:08.125369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:08.125640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:08.126293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:08.126592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:08.127957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:13:08.139863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:08.141061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:13:08.142190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:13:08.142190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:08.142190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:08.143882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 531/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:08.149906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 538/1069] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:08.150990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:08.268021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05192-be17-4de5-9bf5-4f0c5c321374 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:08.298741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:08.308785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:08.312809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:08.312809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:08.312809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:08.312809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:08.312809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:08.312809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:08.325243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 532/1070] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:08.331464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:08.370557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:08.448139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1537b7-a6a4-4854-a4ba-e135e1c9c00b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:08.488495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:08.488495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:08.488495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:08.488495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:08.498566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:08.500069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:13:08.514639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:08.515805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:08.517355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 539/1071] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:13:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:08.521681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:08.624669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c11ca1-9ef9-46ba-b5c6-07f0439fdcb3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:08.672552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:08.673204 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:08.673483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:08.673750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:08.674485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:08.674786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:08.676245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:08.703078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 533/1072] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:13:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:08.708704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:08.808122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:08.818701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e7594-2a7a-43d2-a01d-7dd074559698 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:08.859719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:08.860362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:08.860641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:08.860909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:08.873454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:08.874979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:13:08.891177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:08.893175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:13:08.895122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:13:08.895122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:08.895122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:08.897133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 540/1073] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:08.898397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:08.970278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:09.036711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde70d1-2a3d-4698-a62b-901d7b66b117 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:09.079999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:09.080620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:09.080903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:09.081229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:09.081894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:09.082199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:09.083810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:09.096349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 534/1074] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:09.102044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:09.207660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807421-082d-4d13-9c90-e475df85c89e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:09.243377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414135fb-1a75-4904-ba1c-a4354addad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:09.244026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414135fb-1a75-4904-ba1c-a4354addad78 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:09.244308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414135fb-1a75-4904-ba1c-a4354addad78 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:09.244580 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414135fb-1a75-4904-ba1c-a4354addad78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:09.252433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414135fb-1a75-4904-ba1c-a4354addad78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:09.253981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414135fb-1a75-4904-ba1c-a4354addad78 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-414135fb-1a75-4904-ba1c-a4354addad78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:13:09.267076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:09.268177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:09.276038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 541/1075] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:13:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:09.278674 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:09.373152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef0ff-e747-4008-8c44-9021c942749c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:09.373541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef0ff-e747-4008-8c44-9021c942749c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:09.373885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bef0ff-e747-4008-8c44-9021c942749c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:09.375301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 542/1076] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:13:09.380454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f2d1b-0056-4511-9733-62ddacbf42cb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:09.380740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f2d1b-0056-4511-9733-62ddacbf42cb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:09.381043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f2d1b-0056-4511-9733-62ddacbf42cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:09.387354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:09.393815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccad47e-21c1-479f-a7cf-43c8d7885ae7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:09.400916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-072f2d1b-0056-4511-9733-62ddacbf42cb None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:09.402123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:09.402492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-072f2d1b-0056-4511-9733-62ddacbf42cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:09.438861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:09.439615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:09.440125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:09.440494 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:09.441440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:09.441838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:09.443487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:09.465767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 535/1077] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:13:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:09.474004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:09.491874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 543/1078] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:09.581471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c4fda-5d51-47d6-aa75-ed19868bed48 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:09.618132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b0df2-5de2-46ad-a375-8cd764ab0568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:09.618801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b0df2-5de2-46ad-a375-8cd764ab0568 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:09.619146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b0df2-5de2-46ad-a375-8cd764ab0568 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:09.619450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b0df2-5de2-46ad-a375-8cd764ab0568 None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/2029f59c77de4240a78dba6960735bde/roles/9b23dfdf79d64f72a63fa7d088896eaf` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:09.621686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b0df2-5de2-46ad-a375-8cd764ab0568 None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=2029f59c77de4240a78dba6960735bde, role_id=9b23dfdf79d64f72a63fa7d088896eaf)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:09.623205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b0df2-5de2-46ad-a375-8cd764ab0568 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:09.683687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 536/1079] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:13:09 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/2029f59c77de4240a78dba6960735bde/roles/9b23dfdf79d64f72a63fa7d088896eaf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:13:09.770944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f2d1b-0056-4511-9733-62ddacbf42cb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:09.883071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f2d1b-0056-4511-9733-62ddacbf42cb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:09.920198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:09.925873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fdb09-b10d-422a-9e2c-7c2a3e76dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:09.926527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fdb09-b10d-422a-9e2c-7c2a3e76dc0f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:09.926808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fdb09-b10d-422a-9e2c-7c2a3e76dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:09.927083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fdb09-b10d-422a-9e2c-7c2a3e76dc0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:09.940724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fdb09-b10d-422a-9e2c-7c2a3e76dc0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0c4fdb09-b10d-422a-9e2c-7c2a3e76dc0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:09.946680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:09.947947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:09.949467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 544/1080] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:09.954252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b0df2-5de2-46ad-a375-8cd764ab0568 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:09.985238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:10.063717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b0df2-5de2-46ad-a375-8cd764ab0568 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:10.099089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:10.099691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:10.099974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:10.100245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:10.100919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:10.101252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:10.103245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:10.111662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 537/1081] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:10.117860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fdb09-b10d-422a-9e2c-7c2a3e76dc0f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:10.222948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fdb09-b10d-422a-9e2c-7c2a3e76dc0f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:10.258974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d696441-c5b0-41c2-97bc-f56e5eedb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:10.259611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696441-c5b0-41c2-97bc-f56e5eedb21a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:10.259929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696441-c5b0-41c2-97bc-f56e5eedb21a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:10.260205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d696441-c5b0-41c2-97bc-f56e5eedb21a None admin] PATH_INFO: `/v3/users/99d066cdd42145e389dff9b8de6567f9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:10.261433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d696441-c5b0-41c2-97bc-f56e5eedb21a None admin] RBAC: Authorizing `identity:get_user(user_id=99d066cdd42145e389dff9b8de6567f9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:10.263124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d696441-c5b0-41c2-97bc-f56e5eedb21a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:10.264792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 545/1082] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:10 2022] GET /identity/v3/users/99d066cdd42145e389dff9b8de6567f9 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:10.270908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:10.364828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:10.380084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8429c46-a80f-4699-9163-b4fc90221019 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:10.415923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34079801-f7ba-4f4d-9691-6b1d2858c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:10.416566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079801-f7ba-4f4d-9691-6b1d2858c503 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:10.416839 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079801-f7ba-4f4d-9691-6b1d2858c503 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:10.417142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079801-f7ba-4f4d-9691-6b1d2858c503 None admin] PATH_INFO: `/v3/projects/32d823143a35468581ddc5b9fa5c41f7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:10.418278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34079801-f7ba-4f4d-9691-6b1d2858c503 None admin] RBAC: Authorizing `identity:get_project(project_id=32d823143a35468581ddc5b9fa5c41f7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:10.419721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34079801-f7ba-4f4d-9691-6b1d2858c503 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:10.421576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 538/1083] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:10 2022] GET /identity/v3/projects/32d823143a35468581ddc5b9fa5c41f7 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:10.427819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d696441-c5b0-41c2-97bc-f56e5eedb21a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:10.491948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:10.534346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d696441-c5b0-41c2-97bc-f56e5eedb21a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:10.569369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82744-3537-474b-ba06-c2820dd5add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:10.570030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82744-3537-474b-ba06-c2820dd5add6 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:10.570306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82744-3537-474b-ba06-c2820dd5add6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:10.570576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82744-3537-474b-ba06-c2820dd5add6 None admin] PATH_INFO: `/v3/projects/32d823143a35468581ddc5b9fa5c41f7/users/99d066cdd42145e389dff9b8de6567f9/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:10.572502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f82744-3537-474b-ba06-c2820dd5add6 None admin] RBAC: Authorizing `identity:create_grant(project_id=32d823143a35468581ddc5b9fa5c41f7, user_id=99d066cdd42145e389dff9b8de6567f9, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:10.573949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f82744-3537-474b-ba06-c2820dd5add6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:10.643851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 546/1084] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:13:10 2022] PUT /identity/v3/projects/32d823143a35468581ddc5b9fa5c41f7/users/99d066cdd42145e389dff9b8de6567f9/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:13:11.646819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c11d1-9a34-40d2-bbac-3a459e86d007 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:11.647365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c11d1-9a34-40d2-bbac-3a459e86d007 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:11.647365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c11d1-9a34-40d2-bbac-3a459e86d007 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:11.648697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 539/1085] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:11.654739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52f9c-5740-48a5-9cc1-27c942cc8c52 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:11.655291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52f9c-5740-48a5-9cc1-27c942cc8c52 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:11.655291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52f9c-5740-48a5-9cc1-27c942cc8c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:11.675863 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0db52f9c-5740-48a5-9cc1-27c942cc8c52 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:11.677133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0db52f9c-5740-48a5-9cc1-27c942cc8c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:11.753029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 547/1086] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:12.025918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c11d1-9a34-40d2-bbac-3a459e86d007 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:12.144399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c11d1-9a34-40d2-bbac-3a459e86d007 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:12.194466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285ad5-fbd2-4386-9a1c-78dd05b57897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:12.195559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285ad5-fbd2-4386-9a1c-78dd05b57897 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:12.196105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285ad5-fbd2-4386-9a1c-78dd05b57897 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:12.196606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33285ad5-fbd2-4386-9a1c-78dd05b57897 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:12.215955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33285ad5-fbd2-4386-9a1c-78dd05b57897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-33285ad5-fbd2-4386-9a1c-78dd05b57897 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:12.225911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:12.226880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:13:12.228409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:12.229107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 540/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Sep 5 12:13:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:12.234614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52f9c-5740-48a5-9cc1-27c942cc8c52 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:12.293254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:12.342675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52f9c-5740-48a5-9cc1-27c942cc8c52 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:12.377718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:12.378342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:12.378604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:12.378873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:12.379540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:12.379838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:12.381232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:12.390802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 548/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Sep 5 12:13:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:12.397091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285ad5-fbd2-4386-9a1c-78dd05b57897 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:12.418116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:12.518443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33285ad5-fbd2-4386-9a1c-78dd05b57897 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:12.554828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909d653-a517-4316-a0ef-4b13dcd47b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:12.555404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d653-a517-4316-a0ef-4b13dcd47b7c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:12.555687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d653-a517-4316-a0ef-4b13dcd47b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:12.555959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d653-a517-4316-a0ef-4b13dcd47b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:12.567189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909d653-a517-4316-a0ef-4b13dcd47b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:12.568673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909d653-a517-4316-a0ef-4b13dcd47b7c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-6909d653-a517-4316-a0ef-4b13dcd47b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:13:12.584117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:12.586003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:13:12.587823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:13:12.587823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:12.587823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:12.587823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 541/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:12.591788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:12.610635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d245fdd-82f7-4fdf-8067-8b7b4c82d298 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:12.610912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d245fdd-82f7-4fdf-8067-8b7b4c82d298 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:12.611194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d245fdd-82f7-4fdf-8067-8b7b4c82d298 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:12.612536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 542/1090] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:13:12.617858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979be51-0eb2-4b59-960a-96c3a091792a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:12.618157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979be51-0eb2-4b59-960a-96c3a091792a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:12.618425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979be51-0eb2-4b59-960a-96c3a091792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:12.637131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-d979be51-0eb2-4b59-960a-96c3a091792a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:12.638342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d979be51-0eb2-4b59-960a-96c3a091792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:12.697547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280fceb-f4ff-4243-aedd-edec3b03fa4c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:12.705921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:12.711146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:12.712992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 543/1091] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:12.732728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:12.733404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:12.733682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:12.733956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:12.734632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:12.734933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:12.736308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:12.748679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 549/1092] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:12.754802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979be51-0eb2-4b59-960a-96c3a091792a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:12.874987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979be51-0eb2-4b59-960a-96c3a091792a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:12.929403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:12.930063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:12.930893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:12.931166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:12.941854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:12.943804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:13:12.957921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:12.959159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:12.960387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 544/1093] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Sep 5 12:13:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:12.967827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:12.979969 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.051314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:13.094389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b0f8-ea7e-44cd-93a6-83fa977be518 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.114929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737294-5f2f-4084-a761-a6cf603a89cc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.142447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:13.143069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:13.143346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:13.143615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:13.144371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:13.144673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:13.146203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:13.166436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 550/1094] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Sep 5 12:13:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:13.172317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1728a-2d91-4063-b966-dcdd642a541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:13.173042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1728a-2d91-4063-b966-dcdd642a541f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:13.173288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1728a-2d91-4063-b966-dcdd642a541f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:13.173565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1728a-2d91-4063-b966-dcdd642a541f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:13.174271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.185627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1728a-2d91-4063-b966-dcdd642a541f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-14b1728a-2d91-4063-b966-dcdd642a541f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:13.191269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:13.193258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:13.194690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 545/1095] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:13.198655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1728a-2d91-4063-b966-dcdd642a541f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.213731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:13.299342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3695dd3-558f-4e9e-a778-511d3522dd99 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.314929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1728a-2d91-4063-b966-dcdd642a541f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.333849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:13.340793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c592c8a-077a-435c-a7c8-d8d3e933b537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:13.340793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592c8a-077a-435c-a7c8-d8d3e933b537 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:13.341228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592c8a-077a-435c-a7c8-d8d3e933b537 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:13.341432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592c8a-077a-435c-a7c8-d8d3e933b537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:13.353757 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:13.354282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:13.354573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:13.354860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:13.355545 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:13.355855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:13.357356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:13.369590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 546/1096] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:13:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:13.376056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.421082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c592c8a-077a-435c-a7c8-d8d3e933b537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:13.422649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c592c8a-077a-435c-a7c8-d8d3e933b537 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:13.455110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:13.482700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38213-aec3-4983-9012-ee4513b40a76 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.519667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc7336-cfd9-4809-82af-d57b9da2ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:13.520303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc7336-cfd9-4809-82af-d57b9da2ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:13.520584 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc7336-cfd9-4809-82af-d57b9da2ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:13.520846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc7336-cfd9-4809-82af-d57b9da2ecd2 None admin] PATH_INFO: `/v3/users/99d066cdd42145e389dff9b8de6567f9` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:13.522084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc7336-cfd9-4809-82af-d57b9da2ecd2 None admin] RBAC: Authorizing `identity:get_user(user_id=99d066cdd42145e389dff9b8de6567f9)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:13.523552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc7336-cfd9-4809-82af-d57b9da2ecd2 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:13.525265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 547/1097] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:13 2022] GET /identity/v3/users/99d066cdd42145e389dff9b8de6567f9 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:13.531391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 551/1098] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:13:13.531613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc7336-cfd9-4809-82af-d57b9da2ecd2 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.538948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c592c8a-077a-435c-a7c8-d8d3e933b537 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.585522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:13.641754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc7336-cfd9-4809-82af-d57b9da2ecd2 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.645956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c592c8a-077a-435c-a7c8-d8d3e933b537 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.686041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:13.686564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d3c6-3d2e-46b9-bc4c-c73e44b6712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:13.687187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d3c6-3d2e-46b9-bc4c-c73e44b6712c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:13.687466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d3c6-3d2e-46b9-bc4c-c73e44b6712c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:13.687734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6d3c6-3d2e-46b9-bc4c-c73e44b6712c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:13.691813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:13.692444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:13.692725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:13.693020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:13.704117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:13.705607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:13:13.721180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:13.722300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:13:13.723249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:13:13.723249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:13:13.723249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:13.723249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 552/1099] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:13:13.728125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.761395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6d3c6-3d2e-46b9-bc4c-c73e44b6712c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:13.763203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6d3c6-3d2e-46b9-bc4c-c73e44b6712c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:13.811124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:13.830584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd42df9-41bf-4019-a8da-cc18a34d759e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.865234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:13.865905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:13.866116 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:13.866395 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:13.867036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:13.867342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:13.869294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:13.871115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 548/1100] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:13.876608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d3c6-3d2e-46b9-bc4c-c73e44b6712c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.881469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 553/1101] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:13.887533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:13.934386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:13.986130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6d3c6-3d2e-46b9-bc4c-c73e44b6712c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:13.995080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0296a-5782-4ddf-93d4-dc44562b1880 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:14.022317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde4661-2514-449c-9063-a902635403ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:14.022955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde4661-2514-449c-9063-a902635403ee None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:14.023229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde4661-2514-449c-9063-a902635403ee None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:14.023502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde4661-2514-449c-9063-a902635403ee None admin] PATH_INFO: `/v3/projects/32d823143a35468581ddc5b9fa5c41f7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:14.025725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde4661-2514-449c-9063-a902635403ee None admin] RBAC: Authorizing `identity:get_project(project_id=32d823143a35468581ddc5b9fa5c41f7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:14.028424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde4661-2514-449c-9063-a902635403ee None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:14.031439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 549/1102] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:13 2022] GET /identity/v3/projects/32d823143a35468581ddc5b9fa5c41f7 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:14.034028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:14.034667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:14.034953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:14.035223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:14.037411 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde4661-2514-449c-9063-a902635403ee None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:14.043258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:14.044703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:13:14.057100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:14.058823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:14.059897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 554/1103] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:13:14.061071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:14.064686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:14.148576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde4661-2514-449c-9063-a902635403ee None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:14.173778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd74607-1907-48a1-bcce-754b40c6bff6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:14.175526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:14.184259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:14.184941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:14.185183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:14.185445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:14.186180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=32d823143a35468581ddc5b9fa5c41f7, user.id=99d066cdd42145e389dff9b8de6567f9) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:14.186488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:14.187928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:14.194501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 550/1104] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:14 2022] GET /identity/v3/role_assignments?user.id=99d066cdd42145e389dff9b8de6567f9&scope.project.id=32d823143a35468581ddc5b9fa5c41f7&role.id=41491b52194f43e2902307fb86036726 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:14.220121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674170a6-532b-4e1e-8d79-8340e320798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:14.220751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674170a6-532b-4e1e-8d79-8340e320798e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:14.221067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674170a6-532b-4e1e-8d79-8340e320798e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:14.221343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674170a6-532b-4e1e-8d79-8340e320798e None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:14.222082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674170a6-532b-4e1e-8d79-8340e320798e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:14.222391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674170a6-532b-4e1e-8d79-8340e320798e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:14.223907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674170a6-532b-4e1e-8d79-8340e320798e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:14.238827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 555/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:14.246076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:14.358892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:14.379163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa16147-e0eb-45f6-b6e7-2f8f9f8034c7 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:14.416466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c51ef-95bf-4eb0-b847-a24eff7451c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:14.417109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c51ef-95bf-4eb0-b847-a24eff7451c8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:14.417395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c51ef-95bf-4eb0-b847-a24eff7451c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:14.417668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c51ef-95bf-4eb0-b847-a24eff7451c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:14.418398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c51ef-95bf-4eb0-b847-a24eff7451c8 None admin] RBAC: Adding query filter params (role.id=9b23dfdf79d64f72a63fa7d088896eaf, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=2029f59c77de4240a78dba6960735bde) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:14.418706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c51ef-95bf-4eb0-b847-a24eff7451c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:14.420136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c51ef-95bf-4eb0-b847-a24eff7451c8 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:14.426454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 551/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:14 2022] GET /identity/v3/role_assignments?user.id=2029f59c77de4240a78dba6960735bde&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=9b23dfdf79d64f72a63fa7d088896eaf => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:16.219098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd41597-5e1f-4067-98b6-b0656be0c4d0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:16.219860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd41597-5e1f-4067-98b6-b0656be0c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:16.219860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd41597-5e1f-4067-98b6-b0656be0c4d0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:16.220984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 556/1107] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:16.226561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27efe-ccf9-46b7-866a-d860fc49215d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:16.227005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27efe-ccf9-46b7-866a-d860fc49215d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:16.227705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27efe-ccf9-46b7-866a-d860fc49215d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:16.246522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b4d27efe-ccf9-46b7-866a-d860fc49215d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:16.247811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b4d27efe-ccf9-46b7-866a-d860fc49215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:16.315105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 552/1108] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:16.594039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd41597-5e1f-4067-98b6-b0656be0c4d0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:16.706671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd41597-5e1f-4067-98b6-b0656be0c4d0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:16.741477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1a3d9-50a6-45cb-86fc-d0f00a0c089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:16.742110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a3d9-50a6-45cb-86fc-d0f00a0c089d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:16.742392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a3d9-50a6-45cb-86fc-d0f00a0c089d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:16.743179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a3d9-50a6-45cb-86fc-d0f00a0c089d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:16.744317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1a3d9-50a6-45cb-86fc-d0f00a0c089d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:16.745879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1a3d9-50a6-45cb-86fc-d0f00a0c089d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:16.747464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 557/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:16.753470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d27efe-ccf9-46b7-866a-d860fc49215d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:16.842733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:16.877173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d27efe-ccf9-46b7-866a-d860fc49215d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:16.914527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e4aaf-3fe8-4d86-a63a-549bc1223857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:16.915138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4aaf-3fe8-4d86-a63a-549bc1223857 None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:16.915420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4aaf-3fe8-4d86-a63a-549bc1223857 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:16.915694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4aaf-3fe8-4d86-a63a-549bc1223857 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:16.916366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e4aaf-3fe8-4d86-a63a-549bc1223857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:16.917828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e4aaf-3fe8-4d86-a63a-549bc1223857 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:17.004551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 553/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:13:16 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:19.026513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53a20-3675-4910-8332-781f7acf97e3 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.027321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53a20-3675-4910-8332-781f7acf97e3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.027321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf53a20-3675-4910-8332-781f7acf97e3 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.028675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 558/1111] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:19.033990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d3b4-f517-40c6-ad2d-adbc52647d55 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.034421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d3b4-f517-40c6-ad2d-adbc52647d55 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.034548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d3b4-f517-40c6-ad2d-adbc52647d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.053761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7d73d3b4-f517-40c6-ad2d-adbc52647d55 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:19.054961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7d73d3b4-f517-40c6-ad2d-adbc52647d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:19.126330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 554/1112] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:19.409152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf53a20-3675-4910-8332-781f7acf97e3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:19.442245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:19.521456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf53a20-3675-4910-8332-781f7acf97e3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:19.563278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ca54f-6c5b-42e3-85fa-f5930c020d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:19.563918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca54f-6c5b-42e3-85fa-f5930c020d7d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.564207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca54f-6c5b-42e3-85fa-f5930c020d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.564483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca54f-6c5b-42e3-85fa-f5930c020d7d None admin] PATH_INFO: `/v3/roles/d278ed91749c4adf9b130d08698e7933` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.565916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ca54f-6c5b-42e3-85fa-f5930c020d7d None admin] RBAC: Authorizing `identity:get_role(role_id=d278ed91749c4adf9b130d08698e7933)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:19.567328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ca54f-6c5b-42e3-85fa-f5930c020d7d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:19.568682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 559/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:19 2022] GET /identity/v3/roles/d278ed91749c4adf9b130d08698e7933 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:19.575653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73d3b4-f517-40c6-ad2d-adbc52647d55 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:19.640138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:19.684383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73d3b4-f517-40c6-ad2d-adbc52647d55 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:19.718898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88936630-2557-4b34-9002-62fd6936dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:19.719537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936630-2557-4b34-9002-62fd6936dae5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.719824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936630-2557-4b34-9002-62fd6936dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.720099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936630-2557-4b34-9002-62fd6936dae5 None admin] PATH_INFO: `/v3/users/67eadf0ed28f4f999270e5db9ac29a4a` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.734049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88936630-2557-4b34-9002-62fd6936dae5 None admin] RBAC: Authorizing `identity:get_user(user_id=67eadf0ed28f4f999270e5db9ac29a4a)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:19.735512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88936630-2557-4b34-9002-62fd6936dae5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:19.737309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 555/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:19 2022] GET /identity/v3/users/67eadf0ed28f4f999270e5db9ac29a4a => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:19.743790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ca54f-6c5b-42e3-85fa-f5930c020d7d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:19.843106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:19.846919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ca54f-6c5b-42e3-85fa-f5930c020d7d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:19.881839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9b0b3-1c53-426a-9cdd-9d7d51ad0bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:19.882713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9b0b3-1c53-426a-9cdd-9d7d51ad0bba None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.883162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9b0b3-1c53-426a-9cdd-9d7d51ad0bba None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.884378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9b0b3-1c53-426a-9cdd-9d7d51ad0bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.960633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9b0b3-1c53-426a-9cdd-9d7d51ad0bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:19.962096 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9b0b3-1c53-426a-9cdd-9d7d51ad0bba None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:20.066192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:20.071394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 560/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:20.077766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88936630-2557-4b34-9002-62fd6936dae5 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:20.253503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88936630-2557-4b34-9002-62fd6936dae5 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:20.287608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:20.316057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438dd4d-acfd-4faf-b179-5ba63cfa3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:20.317161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438dd4d-acfd-4faf-b179-5ba63cfa3148 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.317648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438dd4d-acfd-4faf-b179-5ba63cfa3148 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.318127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438dd4d-acfd-4faf-b179-5ba63cfa3148 None admin] PATH_INFO: `/v3/projects/32d823143a35468581ddc5b9fa5c41f7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.320167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438dd4d-acfd-4faf-b179-5ba63cfa3148 None admin] RBAC: Authorizing `identity:get_project(project_id=32d823143a35468581ddc5b9fa5c41f7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:20.323925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438dd4d-acfd-4faf-b179-5ba63cfa3148 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:20.327471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 556/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:20 2022] GET /identity/v3/projects/32d823143a35468581ddc5b9fa5c41f7 => generated 311 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:20.333977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9b0b3-1c53-426a-9cdd-9d7d51ad0bba None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:20.437303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9b0b3-1c53-426a-9cdd-9d7d51ad0bba None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:20.473302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0b32-1473-4e1d-a4f4-956a9efb07d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:20.473915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0b32-1473-4e1d-a4f4-956a9efb07d9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.474196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0b32-1473-4e1d-a4f4-956a9efb07d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.474470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0b32-1473-4e1d-a4f4-956a9efb07d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.475204 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0b32-1473-4e1d-a4f4-956a9efb07d9 None admin] RBAC: Adding query filter params (role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=32d823143a35468581ddc5b9fa5c41f7, user.id=67eadf0ed28f4f999270e5db9ac29a4a) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:20.475519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0b32-1473-4e1d-a4f4-956a9efb07d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:20.477006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b0b32-1473-4e1d-a4f4-956a9efb07d9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:20.482792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 561/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:20 2022] GET /identity/v3/role_assignments?user.id=67eadf0ed28f4f999270e5db9ac29a4a&scope.project.id=32d823143a35468581ddc5b9fa5c41f7&role.id=d278ed91749c4adf9b130d08698e7933 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:22.429096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b0796-a598-4feb-bdd8-7489c6e57b0c None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:22.429641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b0796-a598-4feb-bdd8-7489c6e57b0c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:22.429641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b0796-a598-4feb-bdd8-7489c6e57b0c None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:22.431021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 557/1118] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:22.436211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ba26f-4e27-4732-a486-e7f429fc8589 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:22.436624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ba26f-4e27-4732-a486-e7f429fc8589 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:22.436761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ba26f-4e27-4732-a486-e7f429fc8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:22.455604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1d5ba26f-4e27-4732-a486-e7f429fc8589 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:22.456796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1d5ba26f-4e27-4732-a486-e7f429fc8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:22.517464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:22.528932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 562/1119] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:22.802940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b0796-a598-4feb-bdd8-7489c6e57b0c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:22.922279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b0796-a598-4feb-bdd8-7489c6e57b0c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:22.959638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b383af-c258-4a05-af64-8325e2501fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:22.960275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b383af-c258-4a05-af64-8325e2501fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:22.960556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b383af-c258-4a05-af64-8325e2501fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:22.960830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b383af-c258-4a05-af64-8325e2501fc1 None admin] PATH_INFO: `/v3/roles/d278ed91749c4adf9b130d08698e7933` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:22.962326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b383af-c258-4a05-af64-8325e2501fc1 None admin] RBAC: Authorizing `identity:get_role(role_id=d278ed91749c4adf9b130d08698e7933)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:22.963708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b383af-c258-4a05-af64-8325e2501fc1 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:22.965092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 558/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:22 2022] GET /identity/v3/roles/d278ed91749c4adf9b130d08698e7933 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:22.973634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ba26f-4e27-4732-a486-e7f429fc8589 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:23.102272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ba26f-4e27-4732-a486-e7f429fc8589 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:23.139926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e59406-663f-4e82-83dd-50d1bba6d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:23.140564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e59406-663f-4e82-83dd-50d1bba6d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:23.140838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e59406-663f-4e82-83dd-50d1bba6d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:23.141138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e59406-663f-4e82-83dd-50d1bba6d4f5 None admin] PATH_INFO: `/v3/users/67eadf0ed28f4f999270e5db9ac29a4a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:23.142896 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e59406-663f-4e82-83dd-50d1bba6d4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=67eadf0ed28f4f999270e5db9ac29a4a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:23.144337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e59406-663f-4e82-83dd-50d1bba6d4f5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:23.147257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 563/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:22 2022] GET /identity/v3/users/67eadf0ed28f4f999270e5db9ac29a4a => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:23.154108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b383af-c258-4a05-af64-8325e2501fc1 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:23.233325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:23.279956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b383af-c258-4a05-af64-8325e2501fc1 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:23.317622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9beb49-2396-43c0-88b0-0a6f43849690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:23.318257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9beb49-2396-43c0-88b0-0a6f43849690 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:23.318539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9beb49-2396-43c0-88b0-0a6f43849690 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:23.318813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9beb49-2396-43c0-88b0-0a6f43849690 None admin] PATH_INFO: `/v3/projects/32d823143a35468581ddc5b9fa5c41f7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:23.319962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9beb49-2396-43c0-88b0-0a6f43849690 None admin] RBAC: Authorizing `identity:get_project(project_id=32d823143a35468581ddc5b9fa5c41f7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:23.322212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9beb49-2396-43c0-88b0-0a6f43849690 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:23.323881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 559/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:23 2022] GET /identity/v3/projects/32d823143a35468581ddc5b9fa5c41f7 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:23.330097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e59406-663f-4e82-83dd-50d1bba6d4f5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:23.394253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:23.435173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e59406-663f-4e82-83dd-50d1bba6d4f5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:23.469564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aabe2b-d304-49ef-8732-935b41456f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:23.470325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aabe2b-d304-49ef-8732-935b41456f02 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:23.470467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aabe2b-d304-49ef-8732-935b41456f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:23.470731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aabe2b-d304-49ef-8732-935b41456f02 None admin] PATH_INFO: `/v3/projects/32d823143a35468581ddc5b9fa5c41f7/users/67eadf0ed28f4f999270e5db9ac29a4a/roles/d278ed91749c4adf9b130d08698e7933` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:23.472873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aabe2b-d304-49ef-8732-935b41456f02 None admin] RBAC: Authorizing `identity:create_grant(project_id=32d823143a35468581ddc5b9fa5c41f7, user_id=67eadf0ed28f4f999270e5db9ac29a4a, role_id=d278ed91749c4adf9b130d08698e7933)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:23.474349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aabe2b-d304-49ef-8732-935b41456f02 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:23.557735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 564/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:13:23 2022] PUT /identity/v3/projects/32d823143a35468581ddc5b9fa5c41f7/users/67eadf0ed28f4f999270e5db9ac29a4a/roles/d278ed91749c4adf9b130d08698e7933 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:13:25.517408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0228dd-c9e5-4294-b696-49fa111fd2f1 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:25.517989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0228dd-c9e5-4294-b696-49fa111fd2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:25.517989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0228dd-c9e5-4294-b696-49fa111fd2f1 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:25.519284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 560/1124] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:25.525248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88284f-a39a-42e5-8bd5-aa3c5a665018 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:25.525731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88284f-a39a-42e5-8bd5-aa3c5a665018 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:25.525842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88284f-a39a-42e5-8bd5-aa3c5a665018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:25.544219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-dc88284f-a39a-42e5-8bd5-aa3c5a665018 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:25.545466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dc88284f-a39a-42e5-8bd5-aa3c5a665018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:25.613338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 565/1125] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:25.886789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0228dd-c9e5-4294-b696-49fa111fd2f1 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:26.006138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0228dd-c9e5-4294-b696-49fa111fd2f1 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:26.033677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:26.045906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d50e2-abf0-461d-9ac9-ca136c6c41b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:26.055540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d50e2-abf0-461d-9ac9-ca136c6c41b6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:26.055540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d50e2-abf0-461d-9ac9-ca136c6c41b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:26.055540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d50e2-abf0-461d-9ac9-ca136c6c41b6 None admin] PATH_INFO: `/v3/roles/d278ed91749c4adf9b130d08698e7933` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:26.055540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d50e2-abf0-461d-9ac9-ca136c6c41b6 None admin] RBAC: Authorizing `identity:get_role(role_id=d278ed91749c4adf9b130d08698e7933)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:26.055540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d50e2-abf0-461d-9ac9-ca136c6c41b6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:26.055540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 561/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:25 2022] GET /identity/v3/roles/d278ed91749c4adf9b130d08698e7933 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:26.057543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88284f-a39a-42e5-8bd5-aa3c5a665018 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:26.113460 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:26.164452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88284f-a39a-42e5-8bd5-aa3c5a665018 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:26.198770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06501bd7-8195-4bd5-94cb-c4578c7348e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:26.199399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501bd7-8195-4bd5-94cb-c4578c7348e8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:26.199674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501bd7-8195-4bd5-94cb-c4578c7348e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:26.199948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501bd7-8195-4bd5-94cb-c4578c7348e8 None admin] PATH_INFO: `/v3/users/67eadf0ed28f4f999270e5db9ac29a4a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:26.201101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06501bd7-8195-4bd5-94cb-c4578c7348e8 None admin] RBAC: Authorizing `identity:get_user(user_id=67eadf0ed28f4f999270e5db9ac29a4a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:26.202520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06501bd7-8195-4bd5-94cb-c4578c7348e8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:26.204102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 566/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:26 2022] GET /identity/v3/users/67eadf0ed28f4f999270e5db9ac29a4a => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:26.210225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d50e2-abf0-461d-9ac9-ca136c6c41b6 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:26.324843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d50e2-abf0-461d-9ac9-ca136c6c41b6 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:26.365967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed064e-ba0e-47ca-bdb5-fd81cdc90465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:26.366492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed064e-ba0e-47ca-bdb5-fd81cdc90465 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:26.366770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed064e-ba0e-47ca-bdb5-fd81cdc90465 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:26.367040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed064e-ba0e-47ca-bdb5-fd81cdc90465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:26.429928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:26.440668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed064e-ba0e-47ca-bdb5-fd81cdc90465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:26.442162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed064e-ba0e-47ca-bdb5-fd81cdc90465 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:26.549309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 562/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:26.555650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06501bd7-8195-4bd5-94cb-c4578c7348e8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:26.662652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06501bd7-8195-4bd5-94cb-c4578c7348e8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:26.681629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:26.698510 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64d14f-5a31-4683-b4dd-bd0fd6397d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:26.699140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64d14f-5a31-4683-b4dd-bd0fd6397d6c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:26.699412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64d14f-5a31-4683-b4dd-bd0fd6397d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:26.699681 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64d14f-5a31-4683-b4dd-bd0fd6397d6c None admin] PATH_INFO: `/v3/projects/32d823143a35468581ddc5b9fa5c41f7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:26.700781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64d14f-5a31-4683-b4dd-bd0fd6397d6c None admin] RBAC: Authorizing `identity:get_project(project_id=32d823143a35468581ddc5b9fa5c41f7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:26.702227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64d14f-5a31-4683-b4dd-bd0fd6397d6c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:26.703850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 567/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:26 2022] GET /identity/v3/projects/32d823143a35468581ddc5b9fa5c41f7 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:26.710143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed064e-ba0e-47ca-bdb5-fd81cdc90465 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:26.799486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:26.809400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed064e-ba0e-47ca-bdb5-fd81cdc90465 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:26.844332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7cbb8-630a-4b61-80a6-d3785baccdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:26.844859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7cbb8-630a-4b61-80a6-d3785baccdbd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:26.845158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7cbb8-630a-4b61-80a6-d3785baccdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:26.845425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7cbb8-630a-4b61-80a6-d3785baccdbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:26.846139 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7cbb8-630a-4b61-80a6-d3785baccdbd None admin] RBAC: Adding query filter params (role.id=d278ed91749c4adf9b130d08698e7933, scope.project.id=32d823143a35468581ddc5b9fa5c41f7, user.id=67eadf0ed28f4f999270e5db9ac29a4a) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:26.846442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7cbb8-630a-4b61-80a6-d3785baccdbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:26.847857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7cbb8-630a-4b61-80a6-d3785baccdbd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:26.853784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 563/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:26 2022] GET /identity/v3/role_assignments?user.id=67eadf0ed28f4f999270e5db9ac29a4a&scope.project.id=32d823143a35468581ddc5b9fa5c41f7&role.id=d278ed91749c4adf9b130d08698e7933 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:28.761656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d169c2-2d13-4e13-b917-75a26eee6b43 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:28.762202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d169c2-2d13-4e13-b917-75a26eee6b43 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:28.762202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d169c2-2d13-4e13-b917-75a26eee6b43 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:28.763537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 568/1131] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:28.768848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc429c62-f933-4b7c-ba0a-5d09a60ed90e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:28.769328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc429c62-f933-4b7c-ba0a-5d09a60ed90e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:28.769482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc429c62-f933-4b7c-ba0a-5d09a60ed90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:28.790299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-bc429c62-f933-4b7c-ba0a-5d09a60ed90e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:28.791517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bc429c62-f933-4b7c-ba0a-5d09a60ed90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:28.860069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 564/1132] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:29.129236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d169c2-2d13-4e13-b917-75a26eee6b43 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:29.229091 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d169c2-2d13-4e13-b917-75a26eee6b43 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:29.270800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c52b6e-b161-45be-944b-6277c9c2a062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:29.271544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c52b6e-b161-45be-944b-6277c9c2a062 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:29.271829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c52b6e-b161-45be-944b-6277c9c2a062 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:29.272102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c52b6e-b161-45be-944b-6277c9c2a062 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:29.273261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c52b6e-b161-45be-944b-6277c9c2a062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:29.274710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c52b6e-b161-45be-944b-6277c9c2a062 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:29.276327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 569/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:29.282620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc429c62-f933-4b7c-ba0a-5d09a60ed90e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:29.372888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:29.388301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc429c62-f933-4b7c-ba0a-5d09a60ed90e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:29.423431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a240b-a7b2-47cb-9c83-beb52ddf0dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:29.424048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a240b-a7b2-47cb-9c83-beb52ddf0dbf None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:29.424332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a240b-a7b2-47cb-9c83-beb52ddf0dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:29.424606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a240b-a7b2-47cb-9c83-beb52ddf0dbf None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:29.425316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a240b-a7b2-47cb-9c83-beb52ddf0dbf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:29.426751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a240b-a7b2-47cb-9c83-beb52ddf0dbf None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:29.513170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 565/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:13:29 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:31.475926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb5ff1-f22e-4da4-a4a9-bb608f5175f1 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:31.476474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb5ff1-f22e-4da4-a4a9-bb608f5175f1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:31.476474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb5ff1-f22e-4da4-a4a9-bb608f5175f1 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:31.477853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 570/1135] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:31.482926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a06d8-4ce4-42bc-8ead-ac03dfbf4e7e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:31.483307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a06d8-4ce4-42bc-8ead-ac03dfbf4e7e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:31.483484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a06d8-4ce4-42bc-8ead-ac03dfbf4e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:31.501583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-037a06d8-4ce4-42bc-8ead-ac03dfbf4e7e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:31.502776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-037a06d8-4ce4-42bc-8ead-ac03dfbf4e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:31.567488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 566/1136] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:31.850091 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb5ff1-f22e-4da4-a4a9-bb608f5175f1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:31.906940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:31.953110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb5ff1-f22e-4da4-a4a9-bb608f5175f1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:31.989723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac743c9-06c6-459a-b85a-32d250626f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:31.991935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac743c9-06c6-459a-b85a-32d250626f4d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:31.993030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac743c9-06c6-459a-b85a-32d250626f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:31.993179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac743c9-06c6-459a-b85a-32d250626f4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:31.994249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac743c9-06c6-459a-b85a-32d250626f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:31.995687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac743c9-06c6-459a-b85a-32d250626f4d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:31.997331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 571/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:13:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:32.011706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a06d8-4ce4-42bc-8ead-ac03dfbf4e7e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:32.076659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:32.108967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a06d8-4ce4-42bc-8ead-ac03dfbf4e7e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:32.141442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6deb8-b3d1-4ca4-b316-26c9328abfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:32.142035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6deb8-b3d1-4ca4-b316-26c9328abfaf None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:32.142311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6deb8-b3d1-4ca4-b316-26c9328abfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:32.142579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6deb8-b3d1-4ca4-b316-26c9328abfaf None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:32.143226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6deb8-b3d1-4ca4-b316-26c9328abfaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:32.144648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6deb8-b3d1-4ca4-b316-26c9328abfaf None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:32.243730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 567/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:13:32 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:13:34.252909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d163d34-f1aa-4adb-9337-a56c18623c2b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:34.253521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d163d34-f1aa-4adb-9337-a56c18623c2b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:34.253521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d163d34-f1aa-4adb-9337-a56c18623c2b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:34.254831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 572/1139] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:34.260222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a960-e447-420e-9a4c-fff63bee1272 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:34.260656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a960-e447-420e-9a4c-fff63bee1272 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:34.260765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a960-e447-420e-9a4c-fff63bee1272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:34.279122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-62e0a960-e447-420e-9a4c-fff63bee1272 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:34.280358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-62e0a960-e447-420e-9a4c-fff63bee1272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:34.355281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 568/1140] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:34.623773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d163d34-f1aa-4adb-9337-a56c18623c2b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:34.726564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d163d34-f1aa-4adb-9337-a56c18623c2b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:34.749812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:34.761589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d45a-a099-4fa2-80f7-d63ca7f74018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:34.762216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d45a-a099-4fa2-80f7-d63ca7f74018 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:34.762494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d45a-a099-4fa2-80f7-d63ca7f74018 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:34.762759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d45a-a099-4fa2-80f7-d63ca7f74018 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:34.773063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0d45a-a099-4fa2-80f7-d63ca7f74018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0bb0d45a-a099-4fa2-80f7-d63ca7f74018 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:34.779044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:34.780242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:34.781167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 573/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:34.786300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0a960-e447-420e-9a4c-fff63bee1272 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:34.840143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:34.888931 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0a960-e447-420e-9a4c-fff63bee1272 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:34.924816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:34.925466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:34.925748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:34.926020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:34.926706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:34.927008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:34.928392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:34.938048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 569/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:34.944185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d45a-a099-4fa2-80f7-d63ca7f74018 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:35.053925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d45a-a099-4fa2-80f7-d63ca7f74018 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:35.089864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d216b-73f8-4c70-a1ce-f866be06fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:35.090501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d216b-73f8-4c70-a1ce-f866be06fa37 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:35.090781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d216b-73f8-4c70-a1ce-f866be06fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:35.091054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d216b-73f8-4c70-a1ce-f866be06fa37 None admin] PATH_INFO: `/v3/users/e701d2f6463142fa9a0826879da8159a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:35.105401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d216b-73f8-4c70-a1ce-f866be06fa37 None admin] RBAC: Authorizing `identity:get_user(user_id=e701d2f6463142fa9a0826879da8159a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:35.106875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d216b-73f8-4c70-a1ce-f866be06fa37 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:35.108575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 574/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:34 2022] GET /identity/v3/users/e701d2f6463142fa9a0826879da8159a => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:35.114589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:35.221314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219dab3-0a7d-4755-a215-a8078c6ce633 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:35.235370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:35.255572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04881d3-c3eb-44d8-bd1d-fa15499d36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:35.256174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04881d3-c3eb-44d8-bd1d-fa15499d36bc None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:35.256453 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04881d3-c3eb-44d8-bd1d-fa15499d36bc None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:35.259469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04881d3-c3eb-44d8-bd1d-fa15499d36bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:35.329224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04881d3-c3eb-44d8-bd1d-fa15499d36bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:35.330668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04881d3-c3eb-44d8-bd1d-fa15499d36bc None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:35.431668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 570/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:35.437706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d216b-73f8-4c70-a1ce-f866be06fa37 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:35.480793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:35.535345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d216b-73f8-4c70-a1ce-f866be06fa37 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:35.576965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3b608-0cd3-4beb-8603-e79af0d7c434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:35.577612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b608-0cd3-4beb-8603-e79af0d7c434 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:35.577897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b608-0cd3-4beb-8603-e79af0d7c434 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:35.578171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b608-0cd3-4beb-8603-e79af0d7c434 None admin] PATH_INFO: `/v3/projects/43f831a81bb848ad93279c214deb9c4f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:35.579342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b608-0cd3-4beb-8603-e79af0d7c434 None admin] RBAC: Authorizing `identity:get_project(project_id=43f831a81bb848ad93279c214deb9c4f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:35.580790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b608-0cd3-4beb-8603-e79af0d7c434 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:35.582502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 575/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:35 2022] GET /identity/v3/projects/43f831a81bb848ad93279c214deb9c4f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:35.589290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04881d3-c3eb-44d8-bd1d-fa15499d36bc None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:35.605493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:35.695786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04881d3-c3eb-44d8-bd1d-fa15499d36bc None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:35.731909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6fbc0-18f6-46c1-9ec8-dc0400bd2cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:35.732422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6fbc0-18f6-46c1-9ec8-dc0400bd2cea None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:35.732703 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6fbc0-18f6-46c1-9ec8-dc0400bd2cea None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:35.732992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6fbc0-18f6-46c1-9ec8-dc0400bd2cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:35.733724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6fbc0-18f6-46c1-9ec8-dc0400bd2cea None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=43f831a81bb848ad93279c214deb9c4f, user.id=e701d2f6463142fa9a0826879da8159a) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:35.734026 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6fbc0-18f6-46c1-9ec8-dc0400bd2cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:35.735448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6fbc0-18f6-46c1-9ec8-dc0400bd2cea None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:35.741028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 571/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:35 2022] GET /identity/v3/role_assignments?user.id=e701d2f6463142fa9a0826879da8159a&scope.project.id=43f831a81bb848ad93279c214deb9c4f&role.id=41491b52194f43e2902307fb86036726 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:37.621457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d413ba-b675-42fd-abb7-57d171489d4e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:37.622002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d413ba-b675-42fd-abb7-57d171489d4e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:37.622002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d413ba-b675-42fd-abb7-57d171489d4e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:37.623313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 576/1147] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:37.628394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a4922-384e-45c7-9372-43f02da6d530 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:37.628835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a4922-384e-45c7-9372-43f02da6d530 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:37.628930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a4922-384e-45c7-9372-43f02da6d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:37.647338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-396a4922-384e-45c7-9372-43f02da6d530 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:37.648559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-396a4922-384e-45c7-9372-43f02da6d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:37.712940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 572/1148] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:37.982181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d413ba-b675-42fd-abb7-57d171489d4e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:38.099870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d413ba-b675-42fd-abb7-57d171489d4e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:38.110288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:38.135837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c0009-bb7e-444f-97bf-239301699bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:38.136477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c0009-bb7e-444f-97bf-239301699bdd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:38.136755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c0009-bb7e-444f-97bf-239301699bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:38.137047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c0009-bb7e-444f-97bf-239301699bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:38.149879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c0009-bb7e-444f-97bf-239301699bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1e4c0009-bb7e-444f-97bf-239301699bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:38.155058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:38.156222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:38.157539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 577/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:13:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:38.162641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a4922-384e-45c7-9372-43f02da6d530 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:38.174230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:38.269459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a4922-384e-45c7-9372-43f02da6d530 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:38.305898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:38.306505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:38.306790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:38.307063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:38.307751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:38.308055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:38.309507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:38.318695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 573/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:13:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:38.324729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c0009-bb7e-444f-97bf-239301699bdd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:38.427764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c0009-bb7e-444f-97bf-239301699bdd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:38.461593 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a7c4-38c0-4353-a85b-da60eed0938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:38.462230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a7c4-38c0-4353-a85b-da60eed0938b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:38.462512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a7c4-38c0-4353-a85b-da60eed0938b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:38.462788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2a7c4-38c0-4353-a85b-da60eed0938b None admin] PATH_INFO: `/v3/users/e701d2f6463142fa9a0826879da8159a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:38.463931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a7c4-38c0-4353-a85b-da60eed0938b None admin] RBAC: Authorizing `identity:get_user(user_id=e701d2f6463142fa9a0826879da8159a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:38.465415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2a7c4-38c0-4353-a85b-da60eed0938b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:38.467022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 578/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:38 2022] GET /identity/v3/users/e701d2f6463142fa9a0826879da8159a => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:38.472930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:38.544172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:38.574696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28b887-83d7-4d89-9b01-e76511dd412d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:38.607128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a89ac-0840-4ca3-a1ee-6423fa41e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:38.607754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a89ac-0840-4ca3-a1ee-6423fa41e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:38.612256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a89ac-0840-4ca3-a1ee-6423fa41e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:38.612256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a89ac-0840-4ca3-a1ee-6423fa41e9f2 None admin] PATH_INFO: `/v3/projects/43f831a81bb848ad93279c214deb9c4f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:38.612256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a89ac-0840-4ca3-a1ee-6423fa41e9f2 None admin] RBAC: Authorizing `identity:get_project(project_id=43f831a81bb848ad93279c214deb9c4f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:38.612256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a89ac-0840-4ca3-a1ee-6423fa41e9f2 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:38.612618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 574/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:38 2022] GET /identity/v3/projects/43f831a81bb848ad93279c214deb9c4f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:38.618999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a7c4-38c0-4353-a85b-da60eed0938b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:38.660344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:38.733746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2a7c4-38c0-4353-a85b-da60eed0938b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:38.770070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b372b4-b863-4c87-8e8f-bbf7accc650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:38.770736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b372b4-b863-4c87-8e8f-bbf7accc650e None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:38.771018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b372b4-b863-4c87-8e8f-bbf7accc650e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:38.771601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b372b4-b863-4c87-8e8f-bbf7accc650e None admin] PATH_INFO: `/v3/projects/43f831a81bb848ad93279c214deb9c4f/users/e701d2f6463142fa9a0826879da8159a/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:38.773363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b372b4-b863-4c87-8e8f-bbf7accc650e None admin] RBAC: Authorizing `identity:create_grant(project_id=43f831a81bb848ad93279c214deb9c4f, user_id=e701d2f6463142fa9a0826879da8159a, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:38.775420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b372b4-b863-4c87-8e8f-bbf7accc650e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:38.901657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 579/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:13:38 2022] PUT /identity/v3/projects/43f831a81bb848ad93279c214deb9c4f/users/e701d2f6463142fa9a0826879da8159a/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:13:40.841740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acbb4a-0d74-4a75-9c92-5ebc14375f54 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:40.842168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acbb4a-0d74-4a75-9c92-5ebc14375f54 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:40.842283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acbb4a-0d74-4a75-9c92-5ebc14375f54 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:40.843629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 575/1154] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:40.848770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d873-6bf2-4673-b8e0-bbf959a583f9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:40.849250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d873-6bf2-4673-b8e0-bbf959a583f9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:40.849454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d873-6bf2-4673-b8e0-bbf959a583f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:40.868404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d611d873-6bf2-4673-b8e0-bbf959a583f9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:40.869645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d611d873-6bf2-4673-b8e0-bbf959a583f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:40.940574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 580/1155] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:41.208732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acbb4a-0d74-4a75-9c92-5ebc14375f54 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:41.315844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acbb4a-0d74-4a75-9c92-5ebc14375f54 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:41.358928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed9ec0-4df4-49c0-a83b-e42d0d8d430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:41.359593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed9ec0-4df4-49c0-a83b-e42d0d8d430a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:41.359873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed9ec0-4df4-49c0-a83b-e42d0d8d430a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:41.360146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed9ec0-4df4-49c0-a83b-e42d0d8d430a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:41.369078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:41.373859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed9ec0-4df4-49c0-a83b-e42d0d8d430a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-7eed9ec0-4df4-49c0-a83b-e42d0d8d430a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:41.378910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:41.383207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:41.385001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 576/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:41.387017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611d873-6bf2-4673-b8e0-bbf959a583f9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:41.417025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:41.490022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611d873-6bf2-4673-b8e0-bbf959a583f9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:41.522343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:41.522944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:41.523225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:41.524014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:41.524709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:41.525047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:41.526405 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:41.534496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 581/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:41.541034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed9ec0-4df4-49c0-a83b-e42d0d8d430a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:41.636885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed9ec0-4df4-49c0-a83b-e42d0d8d430a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:41.670381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bf512-60a4-43ae-a01f-aefe81dcbdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:41.670996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf512-60a4-43ae-a01f-aefe81dcbdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:41.671280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf512-60a4-43ae-a01f-aefe81dcbdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:41.671555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bf512-60a4-43ae-a01f-aefe81dcbdf2 None admin] PATH_INFO: `/v3/users/e701d2f6463142fa9a0826879da8159a` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:41.672671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bf512-60a4-43ae-a01f-aefe81dcbdf2 None admin] RBAC: Authorizing `identity:get_user(user_id=e701d2f6463142fa9a0826879da8159a)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:41.674137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bf512-60a4-43ae-a01f-aefe81dcbdf2 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:41.675700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 577/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:41 2022] GET /identity/v3/users/e701d2f6463142fa9a0826879da8159a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:41.681689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:41.769557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:41.781724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f96cae-29f4-43b9-9f10-a5ff5eed9823 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:41.814271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f51be-b89d-473a-9bff-4d03142a742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:41.814869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f51be-b89d-473a-9bff-4d03142a742a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:41.815145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f51be-b89d-473a-9bff-4d03142a742a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:41.815411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f51be-b89d-473a-9bff-4d03142a742a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:41.880523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f51be-b89d-473a-9bff-4d03142a742a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:41.881994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f51be-b89d-473a-9bff-4d03142a742a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:41.966568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:41.978581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 582/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:41.984502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bf512-60a4-43ae-a01f-aefe81dcbdf2 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:42.049286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:42.083296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bf512-60a4-43ae-a01f-aefe81dcbdf2 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:42.115852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c0ad8-614e-4bf2-bc8f-a66eede8b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:42.116469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0ad8-614e-4bf2-bc8f-a66eede8b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:42.116752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0ad8-614e-4bf2-bc8f-a66eede8b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:42.117048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c0ad8-614e-4bf2-bc8f-a66eede8b4e0 None admin] PATH_INFO: `/v3/projects/43f831a81bb848ad93279c214deb9c4f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:42.118683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c0ad8-614e-4bf2-bc8f-a66eede8b4e0 None admin] RBAC: Authorizing `identity:get_project(project_id=43f831a81bb848ad93279c214deb9c4f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:42.120111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c0ad8-614e-4bf2-bc8f-a66eede8b4e0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:42.121749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 578/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:41 2022] GET /identity/v3/projects/43f831a81bb848ad93279c214deb9c4f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:42.128032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f51be-b89d-473a-9bff-4d03142a742a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:42.227689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f51be-b89d-473a-9bff-4d03142a742a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:42.262741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e444d-edaf-4028-bc0b-2dfc1e4c4f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:42.263344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e444d-edaf-4028-bc0b-2dfc1e4c4f68 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:42.263625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e444d-edaf-4028-bc0b-2dfc1e4c4f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:42.263900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e444d-edaf-4028-bc0b-2dfc1e4c4f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:42.264632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e444d-edaf-4028-bc0b-2dfc1e4c4f68 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=43f831a81bb848ad93279c214deb9c4f, user.id=e701d2f6463142fa9a0826879da8159a) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:42.264940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e444d-edaf-4028-bc0b-2dfc1e4c4f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:42.266395 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e444d-edaf-4028-bc0b-2dfc1e4c4f68 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:42.272762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 583/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:42 2022] GET /identity/v3/role_assignments?user.id=e701d2f6463142fa9a0826879da8159a&scope.project.id=43f831a81bb848ad93279c214deb9c4f&role.id=41491b52194f43e2902307fb86036726 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:44.199776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eb43f-88b1-442c-93e6-fddaac8ca6ed None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:44.200371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eb43f-88b1-442c-93e6-fddaac8ca6ed None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:44.200371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eb43f-88b1-442c-93e6-fddaac8ca6ed None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:44.201699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 579/1162] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:44.206975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe9da-85d7-405d-81d9-00a906cf9bc3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:44.207383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe9da-85d7-405d-81d9-00a906cf9bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:44.207526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efe9da-85d7-405d-81d9-00a906cf9bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:44.225997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c4efe9da-85d7-405d-81d9-00a906cf9bc3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:44.227192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c4efe9da-85d7-405d-81d9-00a906cf9bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:44.272814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:44.294061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 584/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:44.562284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eb43f-88b1-442c-93e6-fddaac8ca6ed None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:44.660205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eb43f-88b1-442c-93e6-fddaac8ca6ed None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:44.692503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497a412-470d-4ab9-97a6-b31179af2704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:44.693130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a412-470d-4ab9-97a6-b31179af2704 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:44.693409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a412-470d-4ab9-97a6-b31179af2704 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:44.693682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497a412-470d-4ab9-97a6-b31179af2704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:44.696756 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:44.759806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497a412-470d-4ab9-97a6-b31179af2704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:44.761280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497a412-470d-4ab9-97a6-b31179af2704 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:44.859275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 580/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:44.865384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efe9da-85d7-405d-81d9-00a906cf9bc3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:44.973931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efe9da-85d7-405d-81d9-00a906cf9bc3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:45.009234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877b71d-1fd7-47d6-ace8-d9de764e630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:45.009860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877b71d-1fd7-47d6-ace8-d9de764e630f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:45.010147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877b71d-1fd7-47d6-ace8-d9de764e630f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:45.010420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877b71d-1fd7-47d6-ace8-d9de764e630f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:45.017171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877b71d-1fd7-47d6-ace8-d9de764e630f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:45.018605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877b71d-1fd7-47d6-ace8-d9de764e630f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8877b71d-1fd7-47d6-ace8-d9de764e630f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:45.031796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:45.033161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:13:45.034101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 585/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:13:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:45.039518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497a412-470d-4ab9-97a6-b31179af2704 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:45.072479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:45.136446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497a412-470d-4ab9-97a6-b31179af2704 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:45.170066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a33ef7-8392-4f84-8220-c3025b3c520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:45.170661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33ef7-8392-4f84-8220-c3025b3c520b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:45.170938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33ef7-8392-4f84-8220-c3025b3c520b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:45.171206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33ef7-8392-4f84-8220-c3025b3c520b None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:45.171839 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a33ef7-8392-4f84-8220-c3025b3c520b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:45.172138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a33ef7-8392-4f84-8220-c3025b3c520b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:45.173526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a33ef7-8392-4f84-8220-c3025b3c520b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:45.180511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 581/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Sep 5 12:13:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:47.094834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344afc9-5614-46d0-89cb-4a9792b8f854 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:47.095489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344afc9-5614-46d0-89cb-4a9792b8f854 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:47.095489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344afc9-5614-46d0-89cb-4a9792b8f854 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:47.096744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 586/1167] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:47.102015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f2e7-209f-47bd-b556-4f8792c2f7d7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:47.102465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f2e7-209f-47bd-b556-4f8792c2f7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:47.102570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f2e7-209f-47bd-b556-4f8792c2f7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:47.120816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-96a9f2e7-209f-47bd-b556-4f8792c2f7d7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:47.122020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-96a9f2e7-209f-47bd-b556-4f8792c2f7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:47.186012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 582/1168] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:13:47.474210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344afc9-5614-46d0-89cb-4a9792b8f854 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:47.523402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:47.581550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344afc9-5614-46d0-89cb-4a9792b8f854 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:47.615898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32b4d-279b-470c-b389-2074a73c33bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:47.616500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32b4d-279b-470c-b389-2074a73c33bf None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:47.616782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32b4d-279b-470c-b389-2074a73c33bf None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:47.617615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32b4d-279b-470c-b389-2074a73c33bf None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:47.618325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32b4d-279b-470c-b389-2074a73c33bf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:47.619695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32b4d-279b-470c-b389-2074a73c33bf None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:47.744641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 587/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Mon Sep 5 12:13:47 2022] POST /identity/v3/domains => generated 267 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:49.721403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde934-133c-431e-80df-285f8e68d42f None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:49.721967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde934-133c-431e-80df-285f8e68d42f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:49.721967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde934-133c-431e-80df-285f8e68d42f None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:49.723283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 583/1170] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:49.728600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc4b7b-792e-4606-8603-0e3dbbee64b4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:49.729048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc4b7b-792e-4606-8603-0e3dbbee64b4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:49.729191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc4b7b-792e-4606-8603-0e3dbbee64b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:49.747629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a5fc4b7b-792e-4606-8603-0e3dbbee64b4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:49.748818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a5fc4b7b-792e-4606-8603-0e3dbbee64b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:49.813693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 588/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:50.085112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde934-133c-431e-80df-285f8e68d42f None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:50.113854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:50.188533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde934-133c-431e-80df-285f8e68d42f None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:50.221207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3ffc2-5c44-4d14-b26d-3d237bb987c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:50.221823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ffc2-5c44-4d14-b26d-3d237bb987c5 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:50.222106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ffc2-5c44-4d14-b26d-3d237bb987c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:50.222405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3ffc2-5c44-4d14-b26d-3d237bb987c5 None admin] PATH_INFO: `/v3/domains/6d3b332eab1646099d57b3e62098863f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:50.232982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3ffc2-5c44-4d14-b26d-3d237bb987c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6d3b332eab1646099d57b3e62098863f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:50.234441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3ffc2-5c44-4d14-b26d-3d237bb987c5 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:50.236048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 584/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Sep 5 12:13:50 2022] GET /identity/v3/domains/6d3b332eab1646099d57b3e62098863f => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:50.241976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc4b7b-792e-4606-8603-0e3dbbee64b4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:50.272273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:50.339314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc4b7b-792e-4606-8603-0e3dbbee64b4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:50.373406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7d14d-5deb-48c8-ab2a-4d1bade77290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:50.374017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d14d-5deb-48c8-ab2a-4d1bade77290 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:50.374297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d14d-5deb-48c8-ab2a-4d1bade77290 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:50.374569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7d14d-5deb-48c8-ab2a-4d1bade77290 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:50.375220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7d14d-5deb-48c8-ab2a-4d1bade77290 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:50.376655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7d14d-5deb-48c8-ab2a-4d1bade77290 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:50.485691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 589/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:13:50 2022] POST /identity/v3/projects => generated 361 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:52.466948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49744489-7c5a-42d4-b7c6-fff6462d7b10 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:52.467541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49744489-7c5a-42d4-b7c6-fff6462d7b10 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:52.467541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49744489-7c5a-42d4-b7c6-fff6462d7b10 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:52.468838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 585/1174] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:52.474257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02bfa-b648-44e1-9ab4-bb55cb5dfe2e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:52.474692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02bfa-b648-44e1-9ab4-bb55cb5dfe2e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:52.474807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb02bfa-b648-44e1-9ab4-bb55cb5dfe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:52.494385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1eb02bfa-b648-44e1-9ab4-bb55cb5dfe2e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:52.495599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1eb02bfa-b648-44e1-9ab4-bb55cb5dfe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:52.563211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 590/1175] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:52.829819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49744489-7c5a-42d4-b7c6-fff6462d7b10 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:52.922168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:52.935196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49744489-7c5a-42d4-b7c6-fff6462d7b10 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:52.970523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3329dbe-aed6-47d1-b827-64fc45d13566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:52.971153 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329dbe-aed6-47d1-b827-64fc45d13566 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:52.971436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329dbe-aed6-47d1-b827-64fc45d13566 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:52.971710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3329dbe-aed6-47d1-b827-64fc45d13566 None admin] PATH_INFO: `/v3/domains/6d3b332eab1646099d57b3e62098863f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:52.972845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3329dbe-aed6-47d1-b827-64fc45d13566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6d3b332eab1646099d57b3e62098863f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:52.974320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3329dbe-aed6-47d1-b827-64fc45d13566 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:52.975911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 586/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Sep 5 12:13:52 2022] GET /identity/v3/domains/6d3b332eab1646099d57b3e62098863f => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:52.982534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb02bfa-b648-44e1-9ab4-bb55cb5dfe2e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:52.998077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:53.084830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb02bfa-b648-44e1-9ab4-bb55cb5dfe2e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:53.118393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781af68-8c92-4efa-b964-1f16a6252aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:53.119008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781af68-8c92-4efa-b964-1f16a6252aaa None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:53.119292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781af68-8c92-4efa-b964-1f16a6252aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:53.119568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781af68-8c92-4efa-b964-1f16a6252aaa None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:53.120236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781af68-8c92-4efa-b964-1f16a6252aaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:53.121694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c781af68-8c92-4efa-b964-1f16a6252aaa None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:53.232494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 591/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:13:52 2022] POST /identity/v3/users => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:55.199928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddc392-b035-4164-9578-7343c109fe3b None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:55.200558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddc392-b035-4164-9578-7343c109fe3b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:55.200558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddc392-b035-4164-9578-7343c109fe3b None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:55.201825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 587/1178] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:55.207218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915182fb-9504-4fdc-af53-6c48726ed3b5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:55.207711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915182fb-9504-4fdc-af53-6c48726ed3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:55.207807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915182fb-9504-4fdc-af53-6c48726ed3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:55.227363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-915182fb-9504-4fdc-af53-6c48726ed3b5 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:55.228582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-915182fb-9504-4fdc-af53-6c48726ed3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:55.291923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:55.296446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 592/1179] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:55.569593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddc392-b035-4164-9578-7343c109fe3b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:55.669650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddc392-b035-4164-9578-7343c109fe3b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:55.703155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a7efe-22c2-4820-bfdc-25eddeb70504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:55.703775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7efe-22c2-4820-bfdc-25eddeb70504 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:55.704058 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7efe-22c2-4820-bfdc-25eddeb70504 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:55.704333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7efe-22c2-4820-bfdc-25eddeb70504 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:55.714110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a7efe-22c2-4820-bfdc-25eddeb70504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-af1a7efe-22c2-4820-bfdc-25eddeb70504 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:55.718953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:55.720087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:55.720991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 588/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:55.726058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915182fb-9504-4fdc-af53-6c48726ed3b5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:55.823675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915182fb-9504-4fdc-af53-6c48726ed3b5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:55.856439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:55.857072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:55.857358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:55.857631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:55.858298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:55.858601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:55.859963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:55.868457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 593/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:13:55.874169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a7efe-22c2-4820-bfdc-25eddeb70504 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:55.893117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:55.977791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a7efe-22c2-4820-bfdc-25eddeb70504 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:56.011537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ac072-6258-43f0-9e5d-90e8a1b65bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:56.012165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ac072-6258-43f0-9e5d-90e8a1b65bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:56.012443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ac072-6258-43f0-9e5d-90e8a1b65bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:56.012714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ac072-6258-43f0-9e5d-90e8a1b65bd0 None admin] PATH_INFO: `/v3/users/79cc1442c0b141198ef510ceb6b8af23` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:56.026587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ac072-6258-43f0-9e5d-90e8a1b65bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=79cc1442c0b141198ef510ceb6b8af23)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:56.028048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ac072-6258-43f0-9e5d-90e8a1b65bd0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:56.029988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 589/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:55 2022] GET /identity/v3/users/79cc1442c0b141198ef510ceb6b8af23 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:56.036078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:56.097208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:56.135203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e52a0b-8113-473f-9392-61cf5cc2e185 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:56.168879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8b63-1001-4e16-9734-28cccbb74c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:56.169519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8b63-1001-4e16-9734-28cccbb74c83 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:56.169803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8b63-1001-4e16-9734-28cccbb74c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:56.170081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8b63-1001-4e16-9734-28cccbb74c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:56.237915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e8b63-1001-4e16-9734-28cccbb74c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:56.239371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e8b63-1001-4e16-9734-28cccbb74c83 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:56.300185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:56.341911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 594/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:13:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:13:56.348310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ac072-6258-43f0-9e5d-90e8a1b65bd0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:56.428648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:56.457200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ac072-6258-43f0-9e5d-90e8a1b65bd0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:56.493628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c1840-9a62-425e-bc3e-7f5516e2dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:56.494274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c1840-9a62-425e-bc3e-7f5516e2dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:56.494558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c1840-9a62-425e-bc3e-7f5516e2dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:56.494841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c1840-9a62-425e-bc3e-7f5516e2dbd9 None admin] PATH_INFO: `/v3/projects/aa68d93a8e094deba5ad8bca93b5efaf` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:56.496094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c1840-9a62-425e-bc3e-7f5516e2dbd9 None admin] RBAC: Authorizing `identity:get_project(project_id=aa68d93a8e094deba5ad8bca93b5efaf)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:56.497583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c1840-9a62-425e-bc3e-7f5516e2dbd9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:56.499261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 590/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:56 2022] GET /identity/v3/projects/aa68d93a8e094deba5ad8bca93b5efaf => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:56.505845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8b63-1001-4e16-9734-28cccbb74c83 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:56.608247 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8b63-1001-4e16-9734-28cccbb74c83 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:56.643123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10a534-2063-483d-b1a5-1fd40251d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:56.643714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10a534-2063-483d-b1a5-1fd40251d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:56.644056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10a534-2063-483d-b1a5-1fd40251d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:56.644328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10a534-2063-483d-b1a5-1fd40251d1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:56.645070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10a534-2063-483d-b1a5-1fd40251d1f5 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=aa68d93a8e094deba5ad8bca93b5efaf, user.id=79cc1442c0b141198ef510ceb6b8af23) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:56.645375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10a534-2063-483d-b1a5-1fd40251d1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:56.646770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10a534-2063-483d-b1a5-1fd40251d1f5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:56.652084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 595/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:13:56 2022] GET /identity/v3/role_assignments?user.id=79cc1442c0b141198ef510ceb6b8af23&scope.project.id=aa68d93a8e094deba5ad8bca93b5efaf&role.id=41491b52194f43e2902307fb86036726 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:58.559039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8459-7ab6-410e-8310-38fb1077b3c2 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:58.559582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8459-7ab6-410e-8310-38fb1077b3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:58.559582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8459-7ab6-410e-8310-38fb1077b3c2 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:58.560892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 591/1186] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:58.566524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104a71-c71e-4fcc-8d8d-cb8a4859a4d9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:58.566920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104a71-c71e-4fcc-8d8d-cb8a4859a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:58.567084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16104a71-c71e-4fcc-8d8d-cb8a4859a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:58.585751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-16104a71-c71e-4fcc-8d8d-cb8a4859a4d9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:58.587501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-16104a71-c71e-4fcc-8d8d-cb8a4859a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:58.608513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:58.657814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 596/1187] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:13:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:13:58.930034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8459-7ab6-410e-8310-38fb1077b3c2 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:59.040613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8459-7ab6-410e-8310-38fb1077b3c2 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:59.076814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb92b5e-4e23-44ab-84f0-d1423b94edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:59.077491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb92b5e-4e23-44ab-84f0-d1423b94edaa None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:59.077775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb92b5e-4e23-44ab-84f0-d1423b94edaa None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:59.078047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb92b5e-4e23-44ab-84f0-d1423b94edaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:59.090068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb92b5e-4e23-44ab-84f0-d1423b94edaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-abb92b5e-4e23-44ab-84f0-d1423b94edaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:13:59.095003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:13:59.096219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:13:59.097324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 592/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:13:59.103158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16104a71-c71e-4fcc-8d8d-cb8a4859a4d9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:59.212576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16104a71-c71e-4fcc-8d8d-cb8a4859a4d9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:59.249976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:59.250600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:59.250882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:59.251157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:59.251845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:59.252151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:59.253668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:59.262963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 597/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:13:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:59.269281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb92b5e-4e23-44ab-84f0-d1423b94edaa None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:59.272830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:59.428826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb92b5e-4e23-44ab-84f0-d1423b94edaa None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:59.469509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf2d0-0f66-498c-bd93-e047ed0bd303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:59.470144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf2d0-0f66-498c-bd93-e047ed0bd303 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:59.470420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf2d0-0f66-498c-bd93-e047ed0bd303 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:59.470690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cf2d0-0f66-498c-bd93-e047ed0bd303 None admin] PATH_INFO: `/v3/users/79cc1442c0b141198ef510ceb6b8af23` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:59.471855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cf2d0-0f66-498c-bd93-e047ed0bd303 None admin] RBAC: Authorizing `identity:get_user(user_id=79cc1442c0b141198ef510ceb6b8af23)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:59.473319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cf2d0-0f66-498c-bd93-e047ed0bd303 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:59.474900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 593/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:13:59 2022] GET /identity/v3/users/79cc1442c0b141198ef510ceb6b8af23 => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:59.481482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:59.501949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:59.594607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2768ce-36f7-46b9-b7c4-666bb246a01b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:59.630488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b53a7-afb9-43d0-b1ea-9582d4ece2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:59.631115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b53a7-afb9-43d0-b1ea-9582d4ece2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:59.631398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b53a7-afb9-43d0-b1ea-9582d4ece2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:59.631669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b53a7-afb9-43d0-b1ea-9582d4ece2d3 None admin] PATH_INFO: `/v3/projects/aa68d93a8e094deba5ad8bca93b5efaf` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:59.633420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b53a7-afb9-43d0-b1ea-9582d4ece2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=aa68d93a8e094deba5ad8bca93b5efaf)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:59.634857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b53a7-afb9-43d0-b1ea-9582d4ece2d3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:59.636537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 598/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:13:59 2022] GET /identity/v3/projects/aa68d93a8e094deba5ad8bca93b5efaf => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:59.642595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf2d0-0f66-498c-bd93-e047ed0bd303 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:59.712281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:59.748394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cf2d0-0f66-498c-bd93-e047ed0bd303 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:59.781819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f07a-54b2-4945-a795-c1b3daa62082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:59.782472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f07a-54b2-4945-a795-c1b3daa62082 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:59.782752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f07a-54b2-4945-a795-c1b3daa62082 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:59.783023 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f07a-54b2-4945-a795-c1b3daa62082 None admin] PATH_INFO: `/v3/projects/aa68d93a8e094deba5ad8bca93b5efaf/users/79cc1442c0b141198ef510ceb6b8af23/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:59.784937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f07a-54b2-4945-a795-c1b3daa62082 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa68d93a8e094deba5ad8bca93b5efaf, user_id=79cc1442c0b141198ef510ceb6b8af23, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:59.786399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f07a-54b2-4945-a795-c1b3daa62082 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:59.878013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 594/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:13:59 2022] PUT /identity/v3/projects/aa68d93a8e094deba5ad8bca93b5efaf/users/79cc1442c0b141198ef510ceb6b8af23/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:14:01.807804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc746-bcbe-49ff-a22c-8ce7936a04d9 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:01.808357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc746-bcbe-49ff-a22c-8ce7936a04d9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:01.808357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcc746-bcbe-49ff-a22c-8ce7936a04d9 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:01.809756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 599/1193] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:14:01.815368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442132-12aa-40b3-8790-6292a21b0954 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:01.816071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442132-12aa-40b3-8790-6292a21b0954 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:01.816071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442132-12aa-40b3-8790-6292a21b0954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:01.837052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-50442132-12aa-40b3-8790-6292a21b0954 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:14:01.838849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-50442132-12aa-40b3-8790-6292a21b0954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:14:01.916746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 595/1194] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:14:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:14:02.181836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcc746-bcbe-49ff-a22c-8ce7936a04d9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:14:02.277531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:14:02.293369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcc746-bcbe-49ff-a22c-8ce7936a04d9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:14:02.326758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943033d4-d72f-4024-ab34-f57df3189d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:14:02.327379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943033d4-d72f-4024-ab34-f57df3189d15 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:02.327768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943033d4-d72f-4024-ab34-f57df3189d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:02.328053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943033d4-d72f-4024-ab34-f57df3189d15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:02.338790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943033d4-d72f-4024-ab34-f57df3189d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-943033d4-d72f-4024-ab34-f57df3189d15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:14:02.344154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:14:02.345364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:14:02.346410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 600/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:14:02.351933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50442132-12aa-40b3-8790-6292a21b0954 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:14:02.413348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:14:02.482691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50442132-12aa-40b3-8790-6292a21b0954 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:14:02.525938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:14:02.526536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:02.526820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:02.527094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:02.527858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:14:02.528161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:14:02.529822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:14:02.537806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 596/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:14:02.543935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943033d4-d72f-4024-ab34-f57df3189d15 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:14:02.665151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943033d4-d72f-4024-ab34-f57df3189d15 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:14:02.699199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700567a7-4ed8-4109-ad64-42f0051b4c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:14:02.699810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700567a7-4ed8-4109-ad64-42f0051b4c72 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:02.700088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700567a7-4ed8-4109-ad64-42f0051b4c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:02.700355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700567a7-4ed8-4109-ad64-42f0051b4c72 None admin] PATH_INFO: `/v3/users/79cc1442c0b141198ef510ceb6b8af23` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:02.701485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700567a7-4ed8-4109-ad64-42f0051b4c72 None admin] RBAC: Authorizing `identity:get_user(user_id=79cc1442c0b141198ef510ceb6b8af23)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:14:02.702906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700567a7-4ed8-4109-ad64-42f0051b4c72 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:14:02.704480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 601/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Sep 5 12:14:02 2022] GET /identity/v3/users/79cc1442c0b141198ef510ceb6b8af23 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:14:02.710627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:14:02.816254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a45848-2c74-4c2e-a7a6-245ce036582c None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:14:02.840280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:14:02.852430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a895c6-acf4-456b-b541-001bfe69660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:14:02.853117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a895c6-acf4-456b-b541-001bfe69660b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:02.853401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a895c6-acf4-456b-b541-001bfe69660b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:02.853672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a895c6-acf4-456b-b541-001bfe69660b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:02.952661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a895c6-acf4-456b-b541-001bfe69660b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:14:02.954169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a895c6-acf4-456b-b541-001bfe69660b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:14:03.051899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 597/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:14:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:14:03.057820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700567a7-4ed8-4109-ad64-42f0051b4c72 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:14:03.074634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:14:03.161793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700567a7-4ed8-4109-ad64-42f0051b4c72 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:14:03.196022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27f360-6a8e-4a58-adba-cd88fae38653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:14:03.196654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27f360-6a8e-4a58-adba-cd88fae38653 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:03.196935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27f360-6a8e-4a58-adba-cd88fae38653 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:03.197241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27f360-6a8e-4a58-adba-cd88fae38653 None admin] PATH_INFO: `/v3/projects/aa68d93a8e094deba5ad8bca93b5efaf` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:03.198365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27f360-6a8e-4a58-adba-cd88fae38653 None admin] RBAC: Authorizing `identity:get_project(project_id=aa68d93a8e094deba5ad8bca93b5efaf)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:14:03.199807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27f360-6a8e-4a58-adba-cd88fae38653 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:14:03.201463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 602/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Sep 5 12:14:03 2022] GET /identity/v3/projects/aa68d93a8e094deba5ad8bca93b5efaf => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:14:03.207604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a895c6-acf4-456b-b541-001bfe69660b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:14:03.230996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:14:03.330926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a895c6-acf4-456b-b541-001bfe69660b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:14:03.366378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb18d7-e436-4ff3-abb0-0bc308d5367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:14:03.367513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb18d7-e436-4ff3-abb0-0bc308d5367a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:03.367793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb18d7-e436-4ff3-abb0-0bc308d5367a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:03.368064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb18d7-e436-4ff3-abb0-0bc308d5367a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:03.368798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb18d7-e436-4ff3-abb0-0bc308d5367a None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=aa68d93a8e094deba5ad8bca93b5efaf, user.id=79cc1442c0b141198ef510ceb6b8af23) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:14:03.369266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb18d7-e436-4ff3-abb0-0bc308d5367a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:14:03.370711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb18d7-e436-4ff3-abb0-0bc308d5367a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:14:03.376749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 598/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:14:03 2022] GET /identity/v3/role_assignments?user.id=79cc1442c0b141198ef510ceb6b8af23&scope.project.id=aa68d93a8e094deba5ad8bca93b5efaf&role.id=41491b52194f43e2902307fb86036726 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:14:13.191108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=59 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:14:13.374024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=57 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:20.148081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba3144-15dc-4633-87e2-2ce2e67a7390 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:20.148699 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba3144-15dc-4633-87e2-2ce2e67a7390 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:20.148699 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba3144-15dc-4633-87e2-2ce2e67a7390 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:20.150082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 603/1201] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:20.155810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f54a5-393a-49b0-ab47-013c71c8dc8c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:20.156525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f54a5-393a-49b0-ab47-013c71c8dc8c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:20.156626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f54a5-393a-49b0-ab47-013c71c8dc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:20.175152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-191f54a5-393a-49b0-ab47-013c71c8dc8c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:20.176405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-191f54a5-393a-49b0-ab47-013c71c8dc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:20.247377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 599/1202] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:20.541732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba3144-15dc-4633-87e2-2ce2e67a7390 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:20.651963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba3144-15dc-4633-87e2-2ce2e67a7390 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:20.692544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:20.693193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:20.693468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:20.693742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:20.703812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:20.705269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:20.719625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:20.720887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:20.722216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:20.722216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:20.722216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:20.722216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 604/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:20.726828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f54a5-393a-49b0-ab47-013c71c8dc8c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:20.826299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f54a5-393a-49b0-ab47-013c71c8dc8c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:20.856512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:20.862441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f6fdc-d177-4153-8571-12ecf63cb9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:20.863062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6fdc-d177-4153-8571-12ecf63cb9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:20.863344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6fdc-d177-4153-8571-12ecf63cb9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:20.863617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f6fdc-d177-4153-8571-12ecf63cb9c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:20.864269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f6fdc-d177-4153-8571-12ecf63cb9c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:20.864610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f6fdc-d177-4153-8571-12ecf63cb9c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:20.865992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f6fdc-d177-4153-8571-12ecf63cb9c6 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:20.878375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 600/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:20.884025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:20.939665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:20.996446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051912d-eb22-41e9-87b1-12682079f6a4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:21.036053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea01cf5-3c4a-4198-a27c-40661f841a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:21.036671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01cf5-3c4a-4198-a27c-40661f841a63 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:21.036976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01cf5-3c4a-4198-a27c-40661f841a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:21.037385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01cf5-3c4a-4198-a27c-40661f841a63 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:21.037951 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea01cf5-3c4a-4198-a27c-40661f841a63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:21.039384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea01cf5-3c4a-4198-a27c-40661f841a63 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:21.228201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 605/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Sep 5 12:15:20 2022] POST /identity/v3/users => generated 251 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:15:23.229338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1191829-1899-4a30-9405-f44c6e4f40eb None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:23.229917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1191829-1899-4a30-9405-f44c6e4f40eb None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:23.230113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1191829-1899-4a30-9405-f44c6e4f40eb None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:23.231302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 601/1206] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:23.236776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b094fe-6a58-4b2e-9a07-9582b5ce2fb0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:23.237306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b094fe-6a58-4b2e-9a07-9582b5ce2fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:23.237400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b094fe-6a58-4b2e-9a07-9582b5ce2fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:23.256826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b4b094fe-6a58-4b2e-9a07-9582b5ce2fb0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:23.258067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b4b094fe-6a58-4b2e-9a07-9582b5ce2fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:23.330869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 606/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:23.599599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1191829-1899-4a30-9405-f44c6e4f40eb None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:23.703550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1191829-1899-4a30-9405-f44c6e4f40eb None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:23.737217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae754-c3ca-47f9-9a33-5c542dfbb108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:23.737846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae754-c3ca-47f9-9a33-5c542dfbb108 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:23.738124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae754-c3ca-47f9-9a33-5c542dfbb108 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:23.738393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae754-c3ca-47f9-9a33-5c542dfbb108 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:23.749271 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae754-c3ca-47f9-9a33-5c542dfbb108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-098ae754-c3ca-47f9-9a33-5c542dfbb108 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:15:23.754048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:23.755207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:23.756100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 602/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:15:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:23.761303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b094fe-6a58-4b2e-9a07-9582b5ce2fb0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:23.801814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:23.862340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b094fe-6a58-4b2e-9a07-9582b5ce2fb0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:23.898465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:23.899069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:23.899350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:23.899625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:23.900291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:23.900624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:23.902566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:23.910908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 607/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:23.917686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae754-c3ca-47f9-9a33-5c542dfbb108 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:23.969334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:24.021681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae754-c3ca-47f9-9a33-5c542dfbb108 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:24.056719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:24.057401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:24.057727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:24.058007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:24.070922 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:24.072405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:24.088912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:24.093464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:24.094609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:24.094609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:24.094609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:24.094609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 603/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:15:24.096996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:24.202888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:24.206680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db81f8-8c81-4667-8d2a-d2635ec0a599 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:24.244015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:24.244742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:24.244916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:24.245272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:24.245931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:24.246236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:24.247623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:24.260003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 608/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:24.266578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:24.391299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01368d00-61e8-4324-9565-fee6cc127a54 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:24.393071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:24.426361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:24.426992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:24.427269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:24.427539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:24.435585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:24.437163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:15:24.453533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:24.454818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:24.456384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 604/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:24.460929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:24.575872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9d68c-f5f7-47c8-b6ac-b399708409e4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:24.613463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:24.614074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:24.614355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:24.614636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:24.615403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:24.615712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:24.617206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:24.635342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 609/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Sep 5 12:15:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:24.641271 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:24.744247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47a4d1-d3cc-4647-a37a-7f9552fa5711 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:24.778145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb4a8d-3a0a-4678-a3b6-0e395a0b946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:24.778785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4a8d-3a0a-4678-a3b6-0e395a0b946a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:24.779065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4a8d-3a0a-4678-a3b6-0e395a0b946a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:24.779338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb4a8d-3a0a-4678-a3b6-0e395a0b946a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:24.810772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:24.852020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb4a8d-3a0a-4678-a3b6-0e395a0b946a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:24.853514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb4a8d-3a0a-4678-a3b6-0e395a0b946a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:24.955295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 605/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:15:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:15:24.961291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:24.981441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:25.077307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c38bb-2238-4aa6-8c9d-010965eb6dc9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:25.123705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:25.124349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:25.124632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:25.124910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:25.136606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:25.139498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:25.154780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:25.155812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:25.157173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:25.157173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:25.157173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:25.157173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 610/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:25.162926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb4a8d-3a0a-4678-a3b6-0e395a0b946a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:25.233727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:25.273275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb4a8d-3a0a-4678-a3b6-0e395a0b946a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:25.323255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:25.323990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:25.324273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:25.324548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:25.325229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:25.325536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:25.326904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:25.339281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 606/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:25.345473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:25.415862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:25.447186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d3206-e46d-4839-9740-4f71766b2ddc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:25.482670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:25.483312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:25.483637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:25.483878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:25.490788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:25.492243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:15:25.503571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:25.504727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:25.505933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 611/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:15:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:25.510687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:25.616358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9bf3a-7fa9-43a2-96c7-90d88139f884 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:25.638265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:25.649658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b678574-8557-435c-865b-f006fb9ebcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:25.650270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b678574-8557-435c-865b-f006fb9ebcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:25.650702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b678574-8557-435c-865b-f006fb9ebcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:25.650800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b678574-8557-435c-865b-f006fb9ebcc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:25.652185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b678574-8557-435c-865b-f006fb9ebcc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:25.652490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b678574-8557-435c-865b-f006fb9ebcc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:25.654000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b678574-8557-435c-865b-f006fb9ebcc0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:25.668753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 607/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:15:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:25.675195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:25.781189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925782ff-27e9-43c1-b2f1-ef0ffa06975d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:25.810747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:25.816389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a939f-d48b-4bd3-b735-673ceb99d8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:25.817025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a939f-d48b-4bd3-b735-673ceb99d8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:25.817319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a939f-d48b-4bd3-b735-673ceb99d8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:25.817619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a939f-d48b-4bd3-b735-673ceb99d8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:25.818350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a939f-d48b-4bd3-b735-673ceb99d8e6 None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=727c462d975449c7807f774df4e4a451) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:25.818660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a939f-d48b-4bd3-b735-673ceb99d8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:25.820150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a939f-d48b-4bd3-b735-673ceb99d8e6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:25.826584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 612/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:15:25 2022] GET /identity/v3/role_assignments?user.id=727c462d975449c7807f774df4e4a451&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:27.785321 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53aadc-9690-4bbe-8da1-7884df31d216 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:27.785908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53aadc-9690-4bbe-8da1-7884df31d216 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:27.785908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53aadc-9690-4bbe-8da1-7884df31d216 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:27.787195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 608/1220] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:27.793112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55649fe-acbc-48e5-be88-820496de26af None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:27.793589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55649fe-acbc-48e5-be88-820496de26af None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:27.796637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55649fe-acbc-48e5-be88-820496de26af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:27.812652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e55649fe-acbc-48e5-be88-820496de26af None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:27.813892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e55649fe-acbc-48e5-be88-820496de26af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:27.886352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 613/1221] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:28.157888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53aadc-9690-4bbe-8da1-7884df31d216 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:28.258624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53aadc-9690-4bbe-8da1-7884df31d216 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:28.296542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a542584-fa71-4ab8-a8da-3e65bee7818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:28.297195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542584-fa71-4ab8-a8da-3e65bee7818b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:28.297475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542584-fa71-4ab8-a8da-3e65bee7818b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:28.297747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a542584-fa71-4ab8-a8da-3e65bee7818b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:28.308082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a542584-fa71-4ab8-a8da-3e65bee7818b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-6a542584-fa71-4ab8-a8da-3e65bee7818b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:15:28.312914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:28.319165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:28.320297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 609/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:15:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:28.321206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55649fe-acbc-48e5-be88-820496de26af None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:28.420396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55649fe-acbc-48e5-be88-820496de26af None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:28.443743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:28.454596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:28.455193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:28.455472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:28.455744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:28.456407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:28.456710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:28.458117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:28.465978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 614/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:15:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:28.472191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a542584-fa71-4ab8-a8da-3e65bee7818b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:28.524915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:28.586436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a542584-fa71-4ab8-a8da-3e65bee7818b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:28.621021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:28.621656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:28.621939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:28.622214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:28.632676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:28.634172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:28.650882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:28.652722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:28.653691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:28.653691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:28.653691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:28.653691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 610/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:15:28.658953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:28.765209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbf4eb-561b-4a27-936a-7a6bac106bb2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:28.800797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:28.801533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:28.801720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:28.802016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:28.802667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:28.802976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:28.804339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:28.816229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 615/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:28.822190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:28.919401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:28.925842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e77e13-0231-43a9-a177-a84d38a496b9 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:28.959138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:28.959758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:28.960035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:28.960304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:28.967639 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:28.969298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:15:28.980211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:28.981483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:28.983360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 611/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:28.988116 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:29.041654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:29.092853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d7858-ee43-410f-9e86-314f0553285a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:29.125657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:29.126254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:29.126536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:29.126810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:29.127531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:29.127832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:29.129290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:29.146425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 616/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Sep 5 12:15:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:29.152145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:29.253065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f6c80-8124-4d02-8d05-30adb6f4937e None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:29.286190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:29.286817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:29.287107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:29.287373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:29.299661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:29.301077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:29.315500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:29.316702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:29.323770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:29.323770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:29.323770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:29.323770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 612/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:29.324062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:29.423123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8bb6-7947-497d-bae9-23f566645057 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:29.425564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:29.457153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:29.457757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:29.458039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:29.458313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:29.458957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:29.459259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:29.460610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:29.472335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 617/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:29.477925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:29.488273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:29.579797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd9e17-b366-491a-ba67-a68546fa0225 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:29.614425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:29.615059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:29.615340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:29.615613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:29.622850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:29.624282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:15:29.635385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:29.637030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:29.638170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 613/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:29.642410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:29.748503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cbfd6-3d7a-4104-883b-12e93b3a281c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:29.783439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252b7cb-1bf5-4248-af79-c9a5dad657b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:29.784100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b7cb-1bf5-4248-af79-c9a5dad657b1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:29.784388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b7cb-1bf5-4248-af79-c9a5dad657b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:29.784658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252b7cb-1bf5-4248-af79-c9a5dad657b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:29.785393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252b7cb-1bf5-4248-af79-c9a5dad657b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:29.785706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252b7cb-1bf5-4248-af79-c9a5dad657b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:29.787190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252b7cb-1bf5-4248-af79-c9a5dad657b1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:29.801290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 618/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:15:29.807501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:29.876909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:29.912249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4feb69-638f-4df6-bd10-66fb56338c5b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:29.947247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bffce-1b53-4277-add9-9d96c4de82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:29.947909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bffce-1b53-4277-add9-9d96c4de82e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:29.948251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bffce-1b53-4277-add9-9d96c4de82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:29.948533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bffce-1b53-4277-add9-9d96c4de82e7 None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/727c462d975449c7807f774df4e4a451/roles/1fadb9cbee8341babab0edab4777200f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:29.963265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bffce-1b53-4277-add9-9d96c4de82e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=727c462d975449c7807f774df4e4a451, role_id=1fadb9cbee8341babab0edab4777200f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:29.965270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bffce-1b53-4277-add9-9d96c4de82e7 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:30.097319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 614/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:15:29 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/727c462d975449c7807f774df4e4a451/roles/1fadb9cbee8341babab0edab4777200f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:15:32.007386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675fef6-09fc-4a5b-8c7e-9a446961122b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:32.007978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675fef6-09fc-4a5b-8c7e-9a446961122b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:32.008368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675fef6-09fc-4a5b-8c7e-9a446961122b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:32.011574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 619/1233] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:32.017827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d394027-3331-41af-9407-e2b9a9df640c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:32.018324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d394027-3331-41af-9407-e2b9a9df640c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:32.018468 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d394027-3331-41af-9407-e2b9a9df640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:32.047294 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7d394027-3331-41af-9407-e2b9a9df640c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:32.049479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7d394027-3331-41af-9407-e2b9a9df640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:32.116407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 615/1234] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:32.383467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675fef6-09fc-4a5b-8c7e-9a446961122b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:32.408733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:32.487422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675fef6-09fc-4a5b-8c7e-9a446961122b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:32.522905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7b967-7e35-4d61-ae44-547b45265a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:32.523525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b967-7e35-4d61-ae44-547b45265a0d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:32.523806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b967-7e35-4d61-ae44-547b45265a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:32.524076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7b967-7e35-4d61-ae44-547b45265a0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:32.534469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7b967-7e35-4d61-ae44-547b45265a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4ff7b967-7e35-4d61-ae44-547b45265a0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:15:32.539397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:32.540536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:32.542367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 620/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Sep 5 12:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:32.550697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d394027-3331-41af-9407-e2b9a9df640c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:32.603446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:32.658145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d394027-3331-41af-9407-e2b9a9df640c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:32.692085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:32.692693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:32.693003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:32.693421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:32.694075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] RBAC: Adding query filter params (name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:32.694381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:32.695748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:32.703655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 616/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Sep 5 12:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:32.709487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7b967-7e35-4d61-ae44-547b45265a0d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:32.795559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:32.811055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7b967-7e35-4d61-ae44-547b45265a0d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:32.846021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:32.846658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:32.846941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:32.847215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:32.858321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:32.859764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:32.874858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:32.877404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:32.878442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:32.878442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:32.878442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:32.878442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 621/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:32.882379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:32.986611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1bd68-9a80-43e1-ac98-80dddbb2d044 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:32.995632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:33.020068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:33.020750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:33.021060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:33.021340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:33.021987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:33.022295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:33.023665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:33.036679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 617/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:33.043527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:33.147685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48614d-cf75-4be8-8214-d1b12097e76c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:33.183876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:33.184504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:33.184782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:33.185089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:33.187901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:33.193169 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:33.194632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:15:33.206793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:33.207964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:33.209211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 622/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:33.214480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:33.316598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f521ee-d7cd-406a-8ab5-e8d193e0967d None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:33.353282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:33.353896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:33.354180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:33.355005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:33.355739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:33.356046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:33.357548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:33.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 618/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Sep 5 12:15:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:33.382547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:33.486851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37695f-3aa9-4c8c-ac29-cae17b5c8b40 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:33.524825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc6c6-d692-42ce-b0f4-79d9429c0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:33.525466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc6c6-d692-42ce-b0f4-79d9429c0050 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:33.525749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc6c6-d692-42ce-b0f4-79d9429c0050 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:33.526020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bc6c6-d692-42ce-b0f4-79d9429c0050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:33.591571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:33.598688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc6c6-d692-42ce-b0f4-79d9429c0050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:33.600119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bc6c6-d692-42ce-b0f4-79d9429c0050 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:33.699992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 623/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:15:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:15:33.706203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:33.736083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:33.810198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6d2f-8657-430e-9e21-041aac1617ee None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:33.864287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:33.865404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:33.866216 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:33.866710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:33.886108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:33.888914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:33.917637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:33.918891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:33.919847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:33.919847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:33.919847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:33.919847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 619/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:33.929351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc6c6-d692-42ce-b0f4-79d9429c0050 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:34.053070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:34.059208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bc6c6-d692-42ce-b0f4-79d9429c0050 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:34.096321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:34.096936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:34.097380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:34.097659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:34.098318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:34.098627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:34.100027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:34.112645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 624/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:34.120766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:34.204166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:34.226280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f8530-dbbe-4900-b95e-c719a31502ff None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:34.262118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:34.262752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:34.263031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:34.263305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:34.270396 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:34.271877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:15:34.286069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:34.288113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:34.289075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 620/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:34.295994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:34.420579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e4cf5-6799-45f6-bd89-1673752e773a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:34.455225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d396f88-473c-4a5b-bb87-09f59e20fdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:34.455837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396f88-473c-4a5b-bb87-09f59e20fdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:34.456120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396f88-473c-4a5b-bb87-09f59e20fdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:34.456393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396f88-473c-4a5b-bb87-09f59e20fdc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:34.457124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396f88-473c-4a5b-bb87-09f59e20fdc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:34.457430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396f88-473c-4a5b-bb87-09f59e20fdc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:34.458873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396f88-473c-4a5b-bb87-09f59e20fdc7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:34.471968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 625/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:34.478462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:34.586895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc56c1-f226-4146-8cbd-3c90521a3e06 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:34.622224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e09d6f-1282-46e9-82bb-c16756c773ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:34.623513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e09d6f-1282-46e9-82bb-c16756c773ab None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:34.625280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e09d6f-1282-46e9-82bb-c16756c773ab None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:34.625568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e09d6f-1282-46e9-82bb-c16756c773ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:34.627500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e09d6f-1282-46e9-82bb-c16756c773ab None admin] RBAC: Adding query filter params (role.id=1fadb9cbee8341babab0edab4777200f, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=727c462d975449c7807f774df4e4a451) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:34.627815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e09d6f-1282-46e9-82bb-c16756c773ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:34.629307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e09d6f-1282-46e9-82bb-c16756c773ab None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:34.636448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 621/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:15:34 2022] GET /identity/v3/role_assignments?user.id=727c462d975449c7807f774df4e4a451&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=1fadb9cbee8341babab0edab4777200f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:36.621781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be3d5-2569-4bfe-a095-7f28382382e2 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:36.622332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be3d5-2569-4bfe-a095-7f28382382e2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:36.622689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14be3d5-2569-4bfe-a095-7f28382382e2 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:36.624269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 626/1247] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:36.630036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163e9a-234e-466f-827e-ee491a7eeb39 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:36.630769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163e9a-234e-466f-827e-ee491a7eeb39 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:36.630769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00163e9a-234e-466f-827e-ee491a7eeb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:36.636907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:36.653040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-00163e9a-234e-466f-827e-ee491a7eeb39 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:36.654269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-00163e9a-234e-466f-827e-ee491a7eeb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:36.724459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 622/1248] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:15:37.004790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be3d5-2569-4bfe-a095-7f28382382e2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:37.023851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:37.113771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14be3d5-2569-4bfe-a095-7f28382382e2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:37.156533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4108f4-40c8-4000-93fb-37de071e206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:37.157444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4108f4-40c8-4000-93fb-37de071e206c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:37.157722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4108f4-40c8-4000-93fb-37de071e206c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:37.158006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4108f4-40c8-4000-93fb-37de071e206c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:37.168293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4108f4-40c8-4000-93fb-37de071e206c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ae4108f4-40c8-4000-93fb-37de071e206c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:15:37.173451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:37.175190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:37.176910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 627/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:15:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:37.180850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00163e9a-234e-466f-827e-ee491a7eeb39 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:37.279629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00163e9a-234e-466f-827e-ee491a7eeb39 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:37.309099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:37.314094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:37.314701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:37.314981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:37.315255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:37.315915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:37.316219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:37.317647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:37.326101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 623/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:15:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:15:37.331997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4108f4-40c8-4000-93fb-37de071e206c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:37.411033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:37.437761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4108f4-40c8-4000-93fb-37de071e206c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:37.470952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:37.471569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:37.471844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:37.472111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:37.481952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:37.483397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:37.498606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:37.502556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:37.503654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:37.503654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:37.503654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:37.503654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 628/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:37.505673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:37.603352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5714cbc-271f-4bb9-93f7-d5b2486f2695 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:37.637083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:37.637750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:37.639686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:37.639686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:37.639686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:37.639686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:37.640493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:37.652097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 624/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:37.658166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:37.759714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57820f-9792-4a4b-bc81-4a6194a9609a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:37.786782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:37.795079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:37.795719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:37.796001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:37.796273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:37.804108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:37.805588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:15:37.817680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:37.818851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:37.820051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 629/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:15:37.824826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:37.883353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:37.929959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55e8c9-5d14-4cf1-a337-41accc90d640 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:37.968923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:37.969609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:37.969886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:37.970159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:37.970894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:37.971203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:37.972636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:37.990244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 625/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Sep 5 12:15:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:37.996290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:38.095989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a322dfd-201c-47fb-b53b-22d8d752f570 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:38.134618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90f539-87ba-45a0-975e-20e4bbce1d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:38.135156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90f539-87ba-45a0-975e-20e4bbce1d48 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:38.135435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90f539-87ba-45a0-975e-20e4bbce1d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:38.135710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90f539-87ba-45a0-975e-20e4bbce1d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:38.189958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:38.201927 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90f539-87ba-45a0-975e-20e4bbce1d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:38.203364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90f539-87ba-45a0-975e-20e4bbce1d48 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:38.300367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 630/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:15:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:15:38.306399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:38.403084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805ce00-e218-49fd-b44a-ac40733b66ec None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:38.416559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:38.436251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:38.436910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:38.437242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:38.437481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:38.447146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:38.449188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:38.463238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:38.464926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:38.466345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:38.466345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:38.466345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:38.466345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 626/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:38.470609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90f539-87ba-45a0-975e-20e4bbce1d48 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:38.557312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:38.568719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90f539-87ba-45a0-975e-20e4bbce1d48 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:38.603035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:38.603634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:38.603911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:38.604177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:38.605435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:38.605744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:38.607097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:38.619021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 631/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:38.625534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:38.731661 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878d8d-8146-4d04-b101-df6976185ed3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:38.765065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:38.765720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:38.766003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:38.766277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:38.773309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:38.774820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:15:38.787986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:38.789136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:38.790237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 627/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:38.795805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:38.898835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf73b34-b0cd-4c8c-b199-e947256e8fc2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:38.939072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69fea9-05d8-44e8-8e10-2acdd45e6c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:38.939677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fea9-05d8-44e8-8e10-2acdd45e6c99 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:38.939961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fea9-05d8-44e8-8e10-2acdd45e6c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:38.940333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fea9-05d8-44e8-8e10-2acdd45e6c99 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:38.941077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69fea9-05d8-44e8-8e10-2acdd45e6c99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:38.941386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69fea9-05d8-44e8-8e10-2acdd45e6c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:38.942835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69fea9-05d8-44e8-8e10-2acdd45e6c99 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:38.955839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 632/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:38.962086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:38.989572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:39.067659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff27327-a2ea-44ec-9719-c232b56bb81a None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:39.104131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58b1a8-1390-401a-a8be-ca353bec6fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:39.104778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b1a8-1390-401a-a8be-ca353bec6fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:39.105093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b1a8-1390-401a-a8be-ca353bec6fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:39.105368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b1a8-1390-401a-a8be-ca353bec6fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:39.106105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58b1a8-1390-401a-a8be-ca353bec6fa8 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=727c462d975449c7807f774df4e4a451) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:39.106412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58b1a8-1390-401a-a8be-ca353bec6fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:39.107851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58b1a8-1390-401a-a8be-ca353bec6fa8 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:39.113881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 628/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:15:38 2022] GET /identity/v3/role_assignments?user.id=727c462d975449c7807f774df4e4a451&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=41491b52194f43e2902307fb86036726 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:41.044350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53e620-8dce-4d53-a44e-0da4557bf4d2 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:41.044935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53e620-8dce-4d53-a44e-0da4557bf4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:41.044935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53e620-8dce-4d53-a44e-0da4557bf4d2 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:41.046275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 633/1261] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:41.053096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6dc49-9843-4906-a5ec-cc378b0a84a4 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:41.053623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6dc49-9843-4906-a5ec-cc378b0a84a4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:41.053716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6dc49-9843-4906-a5ec-cc378b0a84a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:41.081568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-aef6dc49-9843-4906-a5ec-cc378b0a84a4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:41.082837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-aef6dc49-9843-4906-a5ec-cc378b0a84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:41.154631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 629/1262] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:41.435656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53e620-8dce-4d53-a44e-0da4557bf4d2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:41.446923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:41.543412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53e620-8dce-4d53-a44e-0da4557bf4d2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:41.578103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45791d02-1897-45cc-926d-fa63bb3aa77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:41.578724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45791d02-1897-45cc-926d-fa63bb3aa77a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:41.579005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45791d02-1897-45cc-926d-fa63bb3aa77a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:41.579279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45791d02-1897-45cc-926d-fa63bb3aa77a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:41.589438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45791d02-1897-45cc-926d-fa63bb3aa77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-45791d02-1897-45cc-926d-fa63bb3aa77a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:15:41.594345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:41.595449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:41.596673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 634/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:41.601435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6dc49-9843-4906-a5ec-cc378b0a84a4 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:41.620725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:41.703213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6dc49-9843-4906-a5ec-cc378b0a84a4 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:41.737318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:41.738000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:41.738293 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:41.738597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:41.739268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:41.739576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:41.741067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:41.749394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 630/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:41.755277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45791d02-1897-45cc-926d-fa63bb3aa77a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:41.824005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:41.858327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45791d02-1897-45cc-926d-fa63bb3aa77a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:41.892083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:41.892712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:41.893025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:41.893302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:41.903953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:41.905440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:41.921243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:41.922412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:41.923512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:41.923512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:41.923512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:41.923512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 635/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:41.928299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:42.007527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:42.025187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da94-b3d6-497f-97d6-0b6837ff8dfd None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:42.057995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:42.058678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:42.058859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:42.062008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:42.062008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:42.062008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:42.062008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:42.072708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 631/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:42.086246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:42.185522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac568-cf0b-435a-8f05-25106ee03d81 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:42.205708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:42.219975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:42.220604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:42.221029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:42.221308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:42.229664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:42.231114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:15:42.241925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:42.243098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:42.244294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 636/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:42.248828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:42.348386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f1ce8-75a8-4b49-a670-a7774e22f7bd None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:42.381183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:42.381748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:42.385038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:42.385038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:42.385038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:42.385038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:42.385038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:42.393795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:42.402855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 632/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Sep 5 12:15:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:42.408767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:42.509092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13ca8c-56a8-4d18-9662-4b82977887ed None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:42.544531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:42.545189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:42.545472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:42.545745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:42.556702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:42.558785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:42.574224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:42.575476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:42.576507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:42.576507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:42.576507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:42.576507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 637/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:42.581727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:42.688615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc69cc-c236-429c-9e57-bd4c811880d0 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:42.731219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:42.731890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:42.732172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:42.732442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:42.733155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:42.733446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:42.734824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:42.746853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 633/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:42.752987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:42.785371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:42.857631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370a74-7f36-4366-a407-14fa5e656c3c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:42.893038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:42.893670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:42.893957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:42.894230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:42.902177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:42.903672 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:15:42.915894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:42.917666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:42.918588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 638/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:42.923634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:42.985955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:43.029034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9d61-bf2c-4b71-9217-002d2856266f None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:43.064714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13879ac-b063-49a5-8035-4cede58da029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:43.065448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13879ac-b063-49a5-8035-4cede58da029 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:43.065715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13879ac-b063-49a5-8035-4cede58da029 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:43.066030 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13879ac-b063-49a5-8035-4cede58da029 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:43.074402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13879ac-b063-49a5-8035-4cede58da029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:43.074402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13879ac-b063-49a5-8035-4cede58da029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:43.074402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13879ac-b063-49a5-8035-4cede58da029 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:43.080659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 634/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:43.086895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:43.185836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:43.194273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da3f8c-0396-44e6-986b-3119d4881326 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:43.228213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22c1b7-41e6-4675-8f3d-fda4c7acc4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:43.228874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c1b7-41e6-4675-8f3d-fda4c7acc4d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:43.229182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c1b7-41e6-4675-8f3d-fda4c7acc4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:43.229487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22c1b7-41e6-4675-8f3d-fda4c7acc4d7 None admin] PATH_INFO: `/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/727c462d975449c7807f774df4e4a451/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:43.231387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22c1b7-41e6-4675-8f3d-fda4c7acc4d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=786e5d0bf66f42b7b6c134c11a7e3f0a, user_id=727c462d975449c7807f774df4e4a451, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:43.232816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22c1b7-41e6-4675-8f3d-fda4c7acc4d7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:43.382145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 639/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Sep 5 12:15:43 2022] PUT /identity/v3/projects/786e5d0bf66f42b7b6c134c11a7e3f0a/users/727c462d975449c7807f774df4e4a451/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:15:45.306676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbdd31-01b5-421c-9da1-db6a5e726058 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:45.307217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbdd31-01b5-421c-9da1-db6a5e726058 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:45.307217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbdd31-01b5-421c-9da1-db6a5e726058 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:45.309183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 635/1274] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:45.314763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1fecb-d190-40cf-8df4-b5e5b15fde56 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:45.315265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1fecb-d190-40cf-8df4-b5e5b15fde56 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:45.315265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1fecb-d190-40cf-8df4-b5e5b15fde56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:45.333559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-26a1fecb-d190-40cf-8df4-b5e5b15fde56 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:45.334854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-26a1fecb-d190-40cf-8df4-b5e5b15fde56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:45.402616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 640/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:15:45.674259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbdd31-01b5-421c-9da1-db6a5e726058 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:45.777715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbdd31-01b5-421c-9da1-db6a5e726058 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:45.817218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:45.833971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46a1d4-d838-443b-b312-74dae793c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:45.834598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a1d4-d838-443b-b312-74dae793c776 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:45.834881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a1d4-d838-443b-b312-74dae793c776 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:45.835150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a1d4-d838-443b-b312-74dae793c776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:45.845434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46a1d4-d838-443b-b312-74dae793c776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-9d46a1d4-d838-443b-b312-74dae793c776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:15:45.850258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:45.856879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:45.858412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 636/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Sep 5 12:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:45.860924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1fecb-d190-40cf-8df4-b5e5b15fde56 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:45.949450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:45.967193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1fecb-d190-40cf-8df4-b5e5b15fde56 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:46.004027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:46.004635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:46.004916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:46.005217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:46.005887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:46.006190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:46.007551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:46.015715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 641/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Sep 5 12:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:46.023274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46a1d4-d838-443b-b312-74dae793c776 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:46.135014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46a1d4-d838-443b-b312-74dae793c776 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:46.181684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:46.182873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:46.183165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:46.183441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:46.194610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:46.196080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:46.220400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:46.221589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:46.222886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:46.222886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:46.222886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:46.222886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 637/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:46.227684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:46.328234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e169d0f-0619-448a-b189-6c1b02d84692 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:46.362317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:46.362921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:46.363197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:46.363463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:46.364100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:46.364399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:46.365777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:46.378017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 642/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:15:46.383929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:46.414982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:46.483645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc64933-712c-4ac6-ab0c-a73f65e56232 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:46.518242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:46.520794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:46.520794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:46.520794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:46.527135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:46.528572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:15:46.539995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:46.541160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:46.543048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 638/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:46.547526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:46.551479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:46.646240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8714-0b8c-42a8-9a57-0f81353a0d9c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:46.681186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:46.681788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:46.682072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:46.682346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:46.683158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:46.683468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:46.684903 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:46.708857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 643/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Sep 5 12:15:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:46.710100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:46.804845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:46.814275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814193-e1fc-4d18-b37c-4341c1c49c69 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:46.848140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfcced-44d0-4364-bb37-bcae3fed6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:46.848745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfcced-44d0-4364-bb37-bcae3fed6d7b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:46.849061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfcced-44d0-4364-bb37-bcae3fed6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:46.849338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfcced-44d0-4364-bb37-bcae3fed6d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:46.916851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfcced-44d0-4364-bb37-bcae3fed6d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:46.918394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfcced-44d0-4364-bb37-bcae3fed6d7b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:47.006834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:47.019527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 639/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Sep 5 12:15:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:15:47.025563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:47.090183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:47.128422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66ca95-dd8b-4472-abe8-4abd8c4b103b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:47.164355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:47.165066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:47.165350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:47.165623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:47.176177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:47.177666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:15:47.193217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:47.196226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:15:47.197416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:15:47.197416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:15:47.197416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:47.197416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 644/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:47.200782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfcced-44d0-4364-bb37-bcae3fed6d7b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:47.310484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfcced-44d0-4364-bb37-bcae3fed6d7b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:47.343911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c11857-b436-4275-8042-80726c667c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:47.344433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11857-b436-4275-8042-80726c667c2b None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:47.344736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11857-b436-4275-8042-80726c667c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:47.345036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11857-b436-4275-8042-80726c667c2b None admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:47.345678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c11857-b436-4275-8042-80726c667c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:47.345981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c11857-b436-4275-8042-80726c667c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:47.347455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c11857-b436-4275-8042-80726c667c2b None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:47.359342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 640/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Sep 5 12:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:47.365232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:47.467018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b502c18-a75b-46d9-a092-218bfc7e9fd3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:47.481295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:47.502635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:47.503263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:47.503540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:47.503807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:47.510316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:47.511813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:15:47.522846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:47.530949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Sep 05 12:15:47.532078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 645/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Sep 5 12:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:47.533024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c11857-b436-4275-8042-80726c667c2b None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:47.585001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:47.633866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c11857-b436-4275-8042-80726c667c2b None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:47.667531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cffe6-c1dc-4256-b9aa-20b686a2eb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:47.668136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cffe6-c1dc-4256-b9aa-20b686a2eb93 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:47.668415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cffe6-c1dc-4256-b9aa-20b686a2eb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:47.668685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cffe6-c1dc-4256-b9aa-20b686a2eb93 None admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:47.669436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cffe6-c1dc-4256-b9aa-20b686a2eb93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:47.669743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cffe6-c1dc-4256-b9aa-20b686a2eb93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:47.671176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cffe6-c1dc-4256-b9aa-20b686a2eb93 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:47.683691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 641/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Sep 5 12:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:47.689893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:47.789379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c8fe-176f-474e-abd3-b8db044746fb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:47.829631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf99eb-971d-40bb-959e-61ceffdceb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:47.830243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf99eb-971d-40bb-959e-61ceffdceb29 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:47.830524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf99eb-971d-40bb-959e-61ceffdceb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:47.830797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf99eb-971d-40bb-959e-61ceffdceb29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:47.831987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf99eb-971d-40bb-959e-61ceffdceb29 None admin] RBAC: Adding query filter params (role.id=41491b52194f43e2902307fb86036726, scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a, user.id=727c462d975449c7807f774df4e4a451) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:47.831987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf99eb-971d-40bb-959e-61ceffdceb29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:47.833255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf99eb-971d-40bb-959e-61ceffdceb29 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:47.839230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 646/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Sep 5 12:15:47 2022] GET /identity/v3/role_assignments?user.id=727c462d975449c7807f774df4e4a451&scope.project.id=786e5d0bf66f42b7b6c134c11a7e3f0a&role.id=41491b52194f43e2902307fb86036726 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:49.816614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8e49-2bd8-4c16-8515-21724fa5c733 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:49.817211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8e49-2bd8-4c16-8515-21724fa5c733 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:49.817211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d8e49-2bd8-4c16-8515-21724fa5c733 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:49.818595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 642/1288] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:49.824966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8f9c8-e151-4e7f-97da-cb64ffe32291 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:49.825521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8f9c8-e151-4e7f-97da-cb64ffe32291 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:49.825618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8f9c8-e151-4e7f-97da-cb64ffe32291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:49.845271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-53f8f9c8-e151-4e7f-97da-cb64ffe32291 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:49.846538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-53f8f9c8-e151-4e7f-97da-cb64ffe32291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:49.883981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:49.923540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 647/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:50.189059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d8e49-2bd8-4c16-8515-21724fa5c733 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:50.294936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d8e49-2bd8-4c16-8515-21724fa5c733 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:50.306275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:50.330185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:50.330814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:50.331097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:50.331367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:50.331951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:50.333344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:50.342501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:50.343933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:50.345079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 643/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:15:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:50.349959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8f9c8-e151-4e7f-97da-cb64ffe32291 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:50.453088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8f9c8-e151-4e7f-97da-cb64ffe32291 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:50.488221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd46399-9e66-40c9-8fb4-04788a4de510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:50.488828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd46399-9e66-40c9-8fb4-04788a4de510 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:50.489138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd46399-9e66-40c9-8fb4-04788a4de510 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:50.489410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd46399-9e66-40c9-8fb4-04788a4de510 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:50.490044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd46399-9e66-40c9-8fb4-04788a4de510 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:50.490339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd46399-9e66-40c9-8fb4-04788a4de510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:50.491689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd46399-9e66-40c9-8fb4-04788a4de510 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:50.497443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 648/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Sep 5 12:15:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:50.503618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:50.611652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee4291-1b0d-46a0-a2f4-15f57f1f6107 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:50.649749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2f1ef-fa9f-463e-a249-ee3d89b3edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:50.650359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2f1ef-fa9f-463e-a249-ee3d89b3edeb None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:50.650640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2f1ef-fa9f-463e-a249-ee3d89b3edeb None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:50.650911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2f1ef-fa9f-463e-a249-ee3d89b3edeb None admin] PATH_INFO: `/v3/services` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:50.652235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2f1ef-fa9f-463e-a249-ee3d89b3edeb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:50.652539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2f1ef-fa9f-463e-a249-ee3d89b3edeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:50.653950 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2f1ef-fa9f-463e-a249-ee3d89b3edeb None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:50.659049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 644/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Sep 5 12:15:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:52.583995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0116a-c56a-4f30-99aa-5d6ce153f0f4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:52.584577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0116a-c56a-4f30-99aa-5d6ce153f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:52.584577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0116a-c56a-4f30-99aa-5d6ce153f0f4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:52.585951 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 649/1293] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:52.592562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303910-1e85-423f-bbeb-a863281ecf5f None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:52.593074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303910-1e85-423f-bbeb-a863281ecf5f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:52.593226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c303910-1e85-423f-bbeb-a863281ecf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:52.612654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8c303910-1e85-423f-bbeb-a863281ecf5f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:52.613888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8c303910-1e85-423f-bbeb-a863281ecf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:52.644641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:52.683109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 645/1294] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:52.966370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0116a-c56a-4f30-99aa-5d6ce153f0f4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:52.999065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:53.074195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0116a-c56a-4f30-99aa-5d6ce153f0f4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:53.110400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955444e-7355-4f3a-aa72-5ab14989bdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:53.110999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955444e-7355-4f3a-aa72-5ab14989bdc2 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:53.111275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955444e-7355-4f3a-aa72-5ab14989bdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:53.111545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955444e-7355-4f3a-aa72-5ab14989bdc2 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:53.112189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955444e-7355-4f3a-aa72-5ab14989bdc2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:53.113571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955444e-7355-4f3a-aa72-5ab14989bdc2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:53.200552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 650/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Sep 5 12:15:52 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:15:55.140861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4876a-1b9b-4c52-b051-fe2535d279c0 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:55.141449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4876a-1b9b-4c52-b051-fe2535d279c0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:55.141449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4876a-1b9b-4c52-b051-fe2535d279c0 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:55.142777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 646/1296] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:55.147959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31db17-fa0e-4637-972f-6aab9ee34334 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:55.148393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31db17-fa0e-4637-972f-6aab9ee34334 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:55.148488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31db17-fa0e-4637-972f-6aab9ee34334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:55.166584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8f31db17-fa0e-4637-972f-6aab9ee34334 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:55.168276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8f31db17-fa0e-4637-972f-6aab9ee34334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:55.240268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 651/1297] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:55.510233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4876a-1b9b-4c52-b051-fe2535d279c0 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:55.617655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4876a-1b9b-4c52-b051-fe2535d279c0 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:55.653607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:55.654231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:55.654513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:55.654786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:55.655371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:55.656740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:55.665861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:55.667105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:55.667958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 647/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:15:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:15:55.673111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31db17-fa0e-4637-972f-6aab9ee34334 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:55.691303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:55.771423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31db17-fa0e-4637-972f-6aab9ee34334 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:55.805831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:55.806429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:55.806712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:55.806988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:55.807618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:55.807922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:55.809486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:55.814479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 652/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Sep 5 12:15:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:55.820614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:55.852387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:55.918547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f392a4-6cab-40a0-9546-bf5e231f8baa None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:55.958759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b98b1-47b2-4b90-8d2e-f38e92cbef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:55.959369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b98b1-47b2-4b90-8d2e-f38e92cbef5d None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:55.959686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b98b1-47b2-4b90-8d2e-f38e92cbef5d None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:55.959926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b98b1-47b2-4b90-8d2e-f38e92cbef5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:55.960627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b98b1-47b2-4b90-8d2e-f38e92cbef5d None admin] RBAC: Adding query filter params (interface=public, service_id=13ca685faa8d495b8f59e2817ae75bde, region_id=RegionOne) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:55.960935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b98b1-47b2-4b90-8d2e-f38e92cbef5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:55.962324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b98b1-47b2-4b90-8d2e-f38e92cbef5d None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:55.967357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 648/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Sep 5 12:15:55 2022] GET /identity/v3/endpoints?service_id=13ca685faa8d495b8f59e2817ae75bde&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:55.973097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:56.054083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:56.071627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b7f14-ad00-4585-b5c7-7c5e0f6e2899 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:56.104541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d958c-8bc9-45b0-b37a-504a15ef79a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:56.105162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d958c-8bc9-45b0-b37a-504a15ef79a1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:56.105442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d958c-8bc9-45b0-b37a-504a15ef79a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:56.105714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d958c-8bc9-45b0-b37a-504a15ef79a1 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:56.106333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d958c-8bc9-45b0-b37a-504a15ef79a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:56.107676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d958c-8bc9-45b0-b37a-504a15ef79a1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:56.114355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 653/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Sep 5 12:15:55 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:15:58.041438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f71de-744a-4b9f-b8ef-b2909bae6b22 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:58.042629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f71de-744a-4b9f-b8ef-b2909bae6b22 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:58.042629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f71de-744a-4b9f-b8ef-b2909bae6b22 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:58.043933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 649/1302] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:58.049133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c555cc0-1177-4ee5-b936-0b055fa6e9a7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:58.049579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c555cc0-1177-4ee5-b936-0b055fa6e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:58.049673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c555cc0-1177-4ee5-b936-0b055fa6e9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:58.068264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7c555cc0-1177-4ee5-b936-0b055fa6e9a7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:58.069496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7c555cc0-1177-4ee5-b936-0b055fa6e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:58.135689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 654/1303] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:15:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:15:58.399092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f71de-744a-4b9f-b8ef-b2909bae6b22 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:58.495344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:58.502052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f71de-744a-4b9f-b8ef-b2909bae6b22 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:58.535361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:58.535984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:58.536268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:58.536541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:58.537158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:58.538529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:15:58.547992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:15:58.550061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application with Lock( Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: ERROR keystone.server.flask.application Sep 05 12:15:58.551711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 650/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Sep 5 12:15:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:15:58.556265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c555cc0-1177-4ee5-b936-0b055fa6e9a7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:58.632186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:58.655699 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c555cc0-1177-4ee5-b936-0b055fa6e9a7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:58.688096 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843695e-0241-4384-8c31-11a5a2208ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:58.688847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843695e-0241-4384-8c31-11a5a2208ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:58.689155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843695e-0241-4384-8c31-11a5a2208ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:58.689424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843695e-0241-4384-8c31-11a5a2208ba8 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:58.690046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843695e-0241-4384-8c31-11a5a2208ba8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:15:58.690346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843695e-0241-4384-8c31-11a5a2208ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:58.691761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843695e-0241-4384-8c31-11a5a2208ba8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:58.697199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 655/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Sep 5 12:15:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:58.704096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:58.819956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1a8b9-fed0-4550-8bab-f0d7bd1bd5e3 None admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:58.852974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c21f-da02-4c7e-bf68-a54875de503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:58.853588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c21f-da02-4c7e-bf68-a54875de503c None admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:58.853869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c21f-da02-4c7e-bf68-a54875de503c None admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:58.854662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c21f-da02-4c7e-bf68-a54875de503c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:58.855344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528c21f-da02-4c7e-bf68-a54875de503c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:58.856696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528c21f-da02-4c7e-bf68-a54875de503c None admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:58.971902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 651/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:15:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:08.719616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=30 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:08.967080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:41.941521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419395d-e8b3-49a9-82ac-d6f4d9260796 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:41.942095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419395d-e8b3-49a9-82ac-d6f4d9260796 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:41.942095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419395d-e8b3-49a9-82ac-d6f4d9260796 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:41.949594 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d6f-2357-4956-87c5-fedcd4f92011 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:41.950109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d6f-2357-4956-87c5-fedcd4f92011 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:41.950200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce64d6f-2357-4956-87c5-fedcd4f92011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:41.953286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 656/1307] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:22:41 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:42.033833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-3ce64d6f-2357-4956-87c5-fedcd4f92011 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:42.035071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3ce64d6f-2357-4956-87c5-fedcd4f92011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:42.172804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 652/1308] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:22:42.471419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33171b-66ac-4ead-9079-9b0d5fd1e007 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:42.472040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33171b-66ac-4ead-9079-9b0d5fd1e007 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:42.472639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33171b-66ac-4ead-9079-9b0d5fd1e007 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:42.474298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 657/1309] 10.222.0.39 () {54 vars in 965 bytes} [Mon Sep 5 12:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:42.481335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53f380-57a0-4536-b614-1c1f9dc71be1 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:42.481939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53f380-57a0-4536-b614-1c1f9dc71be1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:42.482815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53f380-57a0-4536-b614-1c1f9dc71be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:42.665926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6d53f380-57a0-4536-b614-1c1f9dc71be1 None None] MFA Rules not processed for user `fa7ce8d93f864130a3c079b1aec6b678`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:42.669366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6d53f380-57a0-4536-b614-1c1f9dc71be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:42.702869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:42.789676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 653/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Mon Sep 5 12:22:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:42.800301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33171b-66ac-4ead-9079-9b0d5fd1e007 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:42.802958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ea33171b-66ac-4ead-9079-9b0d5fd1e007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:43.037055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33171b-66ac-4ead-9079-9b0d5fd1e007 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:43.136338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9775ee-36e0-4c93-bbd1-1159a66a51fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:43.137337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9775ee-36e0-4c93-bbd1-1159a66a51fe service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:43.137856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9775ee-36e0-4c93-bbd1-1159a66a51fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:43.138282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9775ee-36e0-4c93-bbd1-1159a66a51fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:43.140177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4a9775ee-36e0-4c93-bbd1-1159a66a51fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:43.211680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:43.283674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9775ee-36e0-4c93-bbd1-1159a66a51fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:43.285460 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9775ee-36e0-4c93-bbd1-1159a66a51fe service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:43.310011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 658/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:45.544568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d66b4-6f15-419b-be0d-a278d53b0b3a None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:45.545174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d66b4-6f15-419b-be0d-a278d53b0b3a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:45.545174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d66b4-6f15-419b-be0d-a278d53b0b3a None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:45.546543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 654/1312] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:45.552120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc2bc-74af-4fc6-bae7-247e8c9f29f8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:45.552628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc2bc-74af-4fc6-bae7-247e8c9f29f8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:45.552889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc2bc-74af-4fc6-bae7-247e8c9f29f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:45.647305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5a8dc2bc-74af-4fc6-bae7-247e8c9f29f8 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:45.648556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5a8dc2bc-74af-4fc6-bae7-247e8c9f29f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:45.752546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 659/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:46.052830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7dc6d-f657-49d7-9097-933c3ced0eb3 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:46.053135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7dc6d-f657-49d7-9097-933c3ced0eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:46.053414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7dc6d-f657-49d7-9097-933c3ced0eb3 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:46.054757 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 655/1314] 10.222.0.39 () {54 vars in 965 bytes} [Mon Sep 5 12:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:46.061502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7d88-e81d-4880-b8d1-24a2d5c73038 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:46.061789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7d88-e81d-4880-b8d1-24a2d5c73038 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:46.062063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7d88-e81d-4880-b8d1-24a2d5c73038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:46.073683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:46.139701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fc7a7d88-e81d-4880-b8d1-24a2d5c73038 None None] MFA Rules not processed for user `fa7ce8d93f864130a3c079b1aec6b678`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:46.140934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fc7a7d88-e81d-4880-b8d1-24a2d5c73038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:46.219186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 660/1315] 10.222.0.39 () {58 vars in 1062 bytes} [Mon Sep 5 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:46.228969 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7dc6d-f657-49d7-9097-933c3ced0eb3 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:46.230518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-18f7dc6d-f657-49d7-9097-933c3ced0eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:46.336404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7dc6d-f657-49d7-9097-933c3ced0eb3 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:46.408449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:46.410934 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cedf1ed-a1d0-4ca7-9f16-0a2d78008f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:46.411809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf1ed-a1d0-4ca7-9f16-0a2d78008f3f service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:46.412091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf1ed-a1d0-4ca7-9f16-0a2d78008f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:46.412359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedf1ed-a1d0-4ca7-9f16-0a2d78008f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:46.414028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6cedf1ed-a1d0-4ca7-9f16-0a2d78008f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:46.525658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf1ed-a1d0-4ca7-9f16-0a2d78008f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:46.527117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cedf1ed-a1d0-4ca7-9f16-0a2d78008f3f service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:46.545553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 656/1316] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:49.397865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b90754-bc5c-4e40-b57d-e04adbe67ded None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:49.398450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b90754-bc5c-4e40-b57d-e04adbe67ded None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:49.398450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b90754-bc5c-4e40-b57d-e04adbe67ded None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:49.400279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 661/1317] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:49.405663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3799ce2-def3-4fb0-a3cc-9671fa05dae7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:49.406141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3799ce2-def3-4fb0-a3cc-9671fa05dae7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:49.406237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3799ce2-def3-4fb0-a3cc-9671fa05dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:49.479973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a3799ce2-def3-4fb0-a3cc-9671fa05dae7 None None] MFA Rules not processed for user `cf96e05ed7054e0e8c8392a93922e1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:49.481157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a3799ce2-def3-4fb0-a3cc-9671fa05dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:49.557123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:49.613975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 657/1318] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:49.900207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b90754-bc5c-4e40-b57d-e04adbe67ded None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:49.901885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-52b90754-bc5c-4e40-b57d-e04adbe67ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:50.013931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b90754-bc5c-4e40-b57d-e04adbe67ded None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:50.016777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:50.089631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5049517-5f99-4f51-ac1e-506d1a8e9bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:50.090148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049517-5f99-4f51-ac1e-506d1a8e9bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:50.090429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049517-5f99-4f51-ac1e-506d1a8e9bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:50.090703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5049517-5f99-4f51-ac1e-506d1a8e9bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:50.092295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d5049517-5f99-4f51-ac1e-506d1a8e9bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:50.203976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049517-5f99-4f51-ac1e-506d1a8e9bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:50.205452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5049517-5f99-4f51-ac1e-506d1a8e9bf3 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:50.224827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 662/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:53.051180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac6656-7ccd-459c-9692-c56d94f011cc None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:53.051777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac6656-7ccd-459c-9692-c56d94f011cc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:53.051777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac6656-7ccd-459c-9692-c56d94f011cc None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:53.053162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 658/1320] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:53.059376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da632-7794-40b2-9168-1f5a88d3a540 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:53.060022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da632-7794-40b2-9168-1f5a88d3a540 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:53.060022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72da632-7794-40b2-9168-1f5a88d3a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:53.107354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:53.137510 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f72da632-7794-40b2-9168-1f5a88d3a540 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:53.138819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f72da632-7794-40b2-9168-1f5a88d3a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:53.261824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 663/1321] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:53.552286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac6656-7ccd-459c-9692-c56d94f011cc None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:53.553868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-38ac6656-7ccd-459c-9692-c56d94f011cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:53.663241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac6656-7ccd-459c-9692-c56d94f011cc None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:53.734550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c02b15-f883-4b84-8413-987eaf23958f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:53.735154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02b15-f883-4b84-8413-987eaf23958f service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:53.735436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02b15-f883-4b84-8413-987eaf23958f service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:53.735706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c02b15-f883-4b84-8413-987eaf23958f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:53.737381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-56c02b15-f883-4b84-8413-987eaf23958f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:53.746019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:53.854083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c02b15-f883-4b84-8413-987eaf23958f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:53.855531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c02b15-f883-4b84-8413-987eaf23958f service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:53.878628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 659/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:56.801638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb201-4f9f-41a2-8d6c-21a5769ec12b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:56.802560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb201-4f9f-41a2-8d6c-21a5769ec12b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:56.802560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb201-4f9f-41a2-8d6c-21a5769ec12b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:56.803769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 664/1323] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:56.809815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54ef0-7505-42c0-b461-fd6616005e6e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:56.810318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54ef0-7505-42c0-b461-fd6616005e6e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:56.810439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54ef0-7505-42c0-b461-fd6616005e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:56.880766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-27c54ef0-7505-42c0-b461-fd6616005e6e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:56.882073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-27c54ef0-7505-42c0-b461-fd6616005e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:56.944300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:56.984638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 660/1324] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:57.274116 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb201-4f9f-41a2-8d6c-21a5769ec12b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:57.276156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-76dfb201-4f9f-41a2-8d6c-21a5769ec12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:57.400008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb201-4f9f-41a2-8d6c-21a5769ec12b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:57.413429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:57.487358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354c1a4-4b25-4922-89a8-e05bbc0687c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:57.487964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c1a4-4b25-4922-89a8-e05bbc0687c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:57.488245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c1a4-4b25-4922-89a8-e05bbc0687c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:57.488519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c1a4-4b25-4922-89a8-e05bbc0687c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:57.490196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4354c1a4-4b25-4922-89a8-e05bbc0687c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:57.604696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354c1a4-4b25-4922-89a8-e05bbc0687c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:57.606177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354c1a4-4b25-4922-89a8-e05bbc0687c0 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:57.626561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 665/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:59.639769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc139e1-8cf8-44fb-b64e-ba7928f30389 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:59.640340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc139e1-8cf8-44fb-b64e-ba7928f30389 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:59.640340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc139e1-8cf8-44fb-b64e-ba7928f30389 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:59.641791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 661/1326] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:59.647625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ac98-1214-4921-9c87-d97c536be317 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:59.648134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ac98-1214-4921-9c87-d97c536be317 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:59.648228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ac98-1214-4921-9c87-d97c536be317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:59.700729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:59.720777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ee04ac98-1214-4921-9c87-d97c536be317 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:59.722019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ee04ac98-1214-4921-9c87-d97c536be317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:59.823114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 666/1327] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:00.107790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc139e1-8cf8-44fb-b64e-ba7928f30389 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:00.109418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7dc139e1-8cf8-44fb-b64e-ba7928f30389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:00.235084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc139e1-8cf8-44fb-b64e-ba7928f30389 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:00.325087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731ddf5-385c-484f-85d8-db9e408842fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:00.325726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731ddf5-385c-484f-85d8-db9e408842fe service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:00.326013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731ddf5-385c-484f-85d8-db9e408842fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:00.326286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731ddf5-385c-484f-85d8-db9e408842fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:00.328100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e731ddf5-385c-484f-85d8-db9e408842fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:00.352927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:00.466162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731ddf5-385c-484f-85d8-db9e408842fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:00.467616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731ddf5-385c-484f-85d8-db9e408842fe service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:00.487406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 662/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:02.469788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb096-de14-40b2-9a41-653d6e618e00 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:02.470421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb096-de14-40b2-9a41-653d6e618e00 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:02.470421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcb096-de14-40b2-9a41-653d6e618e00 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:02.471709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 667/1329] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:02.477008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59c74-2044-473e-b7a5-5f5cc7637c95 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:02.477571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59c74-2044-473e-b7a5-5f5cc7637c95 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:02.477571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59c74-2044-473e-b7a5-5f5cc7637c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:02.547241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-86d59c74-2044-473e-b7a5-5f5cc7637c95 None None] MFA Rules not processed for user `cf96e05ed7054e0e8c8392a93922e1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:02.548366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-86d59c74-2044-473e-b7a5-5f5cc7637c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:02.620353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:02.656065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 663/1330] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:02.945120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcb096-de14-40b2-9a41-653d6e618e00 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:02.947258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b4fcb096-de14-40b2-9a41-653d6e618e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:03.099093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcb096-de14-40b2-9a41-653d6e618e00 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:03.127798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:03.208635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed8997-5656-4f99-aaa7-ce080db07cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:03.209292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8997-5656-4f99-aaa7-ce080db07cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:03.209567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8997-5656-4f99-aaa7-ce080db07cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:03.209832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed8997-5656-4f99-aaa7-ce080db07cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:03.211512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-94ed8997-5656-4f99-aaa7-ce080db07cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:03.352734 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed8997-5656-4f99-aaa7-ce080db07cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:03.355364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed8997-5656-4f99-aaa7-ce080db07cc2 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:03.386327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 668/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:06.111052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4cc86-c078-41df-bb11-1a32b602f843 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:06.111862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4cc86-c078-41df-bb11-1a32b602f843 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:06.112141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4cc86-c078-41df-bb11-1a32b602f843 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:06.113869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 664/1332] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:06.121283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0e95-cd5c-4fdd-bc81-c0122738b4a3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:06.122058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0e95-cd5c-4fdd-bc81-c0122738b4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:06.122231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0e95-cd5c-4fdd-bc81-c0122738b4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:06.246109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:06.250052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-928f0e95-cd5c-4fdd-bc81-c0122738b4a3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:06.251327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-928f0e95-cd5c-4fdd-bc81-c0122738b4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:06.391718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 669/1333] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:06.688487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4cc86-c078-41df-bb11-1a32b602f843 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:06.691245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c3a4cc86-c078-41df-bb11-1a32b602f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:06.829688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4cc86-c078-41df-bb11-1a32b602f843 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:06.933254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe9263-1323-499e-b094-abea8f429e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:06.934033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9263-1323-499e-b094-abea8f429e58 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:06.934750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9263-1323-499e-b094-abea8f429e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:06.935255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9263-1323-499e-b094-abea8f429e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:06.938402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-66fe9263-1323-499e-b094-abea8f429e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:06.974055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:07.080309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe9263-1323-499e-b094-abea8f429e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:07.081824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe9263-1323-499e-b094-abea8f429e58 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:07.103004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 665/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:09.107944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118489af-bd44-4cc3-81be-88d3dfd30f85 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.108549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118489af-bd44-4cc3-81be-88d3dfd30f85 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.108977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118489af-bd44-4cc3-81be-88d3dfd30f85 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.111576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 670/1335] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:09.118175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e19ae-bae7-4abd-b551-de4131071e5d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.118944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e19ae-bae7-4abd-b551-de4131071e5d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.119118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e19ae-bae7-4abd-b551-de4131071e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.195852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-fa0e19ae-bae7-4abd-b551-de4131071e5d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:09.197084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-fa0e19ae-bae7-4abd-b551-de4131071e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:09.285176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:09.310854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 666/1336] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:23:09.599447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118489af-bd44-4cc3-81be-88d3dfd30f85 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:09.601010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-118489af-bd44-4cc3-81be-88d3dfd30f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:09.714481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118489af-bd44-4cc3-81be-88d3dfd30f85 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:09.744500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:09.795123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcf1f8-0e5c-4a4a-943d-b4848b1a8cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:09.795742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1f8-0e5c-4a4a-943d-b4848b1a8cad service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.796024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1f8-0e5c-4a4a-943d-b4848b1a8cad service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.796297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1f8-0e5c-4a4a-943d-b4848b1a8cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.797961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-25fcf1f8-0e5c-4a4a-943d-b4848b1a8cad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:09.916755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf1f8-0e5c-4a4a-943d-b4848b1a8cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:09.918272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf1f8-0e5c-4a4a-943d-b4848b1a8cad service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:09.939306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 671/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:12.557894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304726-072d-44ea-878d-4c8c0b4f7d3d None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:12.558454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304726-072d-44ea-878d-4c8c0b4f7d3d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:12.558454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304726-072d-44ea-878d-4c8c0b4f7d3d None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:12.559808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 667/1338] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:12.565388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace07f7-ecc8-4a2b-86dd-a489b7845690 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:12.565872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace07f7-ecc8-4a2b-86dd-a489b7845690 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:12.565986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace07f7-ecc8-4a2b-86dd-a489b7845690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:12.635048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0ace07f7-ecc8-4a2b-86dd-a489b7845690 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:12.636291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0ace07f7-ecc8-4a2b-86dd-a489b7845690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:12.644586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:12.736969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 672/1339] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:13.032097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed304726-072d-44ea-878d-4c8c0b4f7d3d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:13.034067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ed304726-072d-44ea-878d-4c8c0b4f7d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:13.143382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed304726-072d-44ea-878d-4c8c0b4f7d3d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:13.223192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a3c90-1b17-444c-b638-f020bcf47ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:13.223799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a3c90-1b17-444c-b638-f020bcf47ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:13.224074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a3c90-1b17-444c-b638-f020bcf47ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:13.224337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a3c90-1b17-444c-b638-f020bcf47ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:13.225977 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-306a3c90-1b17-444c-b638-f020bcf47ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:13.265750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:13.351683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a3c90-1b17-444c-b638-f020bcf47ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:13.353158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a3c90-1b17-444c-b638-f020bcf47ed2 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:13.371946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 668/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:17.838212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d4dc4-89ae-47a9-8ccf-49dc3c1977a6 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:17.838700 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d4dc4-89ae-47a9-8ccf-49dc3c1977a6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:17.838811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d4dc4-89ae-47a9-8ccf-49dc3c1977a6 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:17.840924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 673/1341] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:17.847279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e50b1-84b9-4c04-989e-7168d564d9a0 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:17.847838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e50b1-84b9-4c04-989e-7168d564d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:17.847838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e50b1-84b9-4c04-989e-7168d564d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:17.940423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-308e50b1-84b9-4c04-989e-7168d564d9a0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:17.941795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-308e50b1-84b9-4c04-989e-7168d564d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:18.055226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:18.078549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 669/1342] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:18.369936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d4dc4-89ae-47a9-8ccf-49dc3c1977a6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:18.371534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7a3d4dc4-89ae-47a9-8ccf-49dc3c1977a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:18.494986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d4dc4-89ae-47a9-8ccf-49dc3c1977a6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:18.540193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:18.586796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf0347-a542-4b6f-ad7e-479ff47a2395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:18.587416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf0347-a542-4b6f-ad7e-479ff47a2395 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:18.587703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf0347-a542-4b6f-ad7e-479ff47a2395 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:18.587981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf0347-a542-4b6f-ad7e-479ff47a2395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:18.589661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-71cf0347-a542-4b6f-ad7e-479ff47a2395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:18.723752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf0347-a542-4b6f-ad7e-479ff47a2395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:18.725157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf0347-a542-4b6f-ad7e-479ff47a2395 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:18.747731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 674/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:22.075146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5f814-4fd3-4586-a515-f1b9acc2aa4c None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:22.075957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5f814-4fd3-4586-a515-f1b9acc2aa4c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:22.076110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5f814-4fd3-4586-a515-f1b9acc2aa4c None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:22.077768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 670/1344] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:22.083836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ff43-6f17-41b0-a2bf-e50d5e062757 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:22.084398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ff43-6f17-41b0-a2bf-e50d5e062757 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:22.084794 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81ff43-6f17-41b0-a2bf-e50d5e062757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:22.161306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6c81ff43-6f17-41b0-a2bf-e50d5e062757 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:22.162824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6c81ff43-6f17-41b0-a2bf-e50d5e062757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:22.184538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:22.284647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 675/1345] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:22.589851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5f814-4fd3-4586-a515-f1b9acc2aa4c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:22.591393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e7d5f814-4fd3-4586-a515-f1b9acc2aa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:22.730335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5f814-4fd3-4586-a515-f1b9acc2aa4c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:22.820519 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175eae0-b5dd-4aec-9e80-2519032723e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:22.821213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175eae0-b5dd-4aec-9e80-2519032723e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:22.821496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175eae0-b5dd-4aec-9e80-2519032723e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:22.821767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175eae0-b5dd-4aec-9e80-2519032723e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:22.823512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a175eae0-b5dd-4aec-9e80-2519032723e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:22.878868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:22.956457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175eae0-b5dd-4aec-9e80-2519032723e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:22.957968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175eae0-b5dd-4aec-9e80-2519032723e6 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:22.980161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 671/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:27.720381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319e94-11e5-4faf-9228-fd59580eb363 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:27.721117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319e94-11e5-4faf-9228-fd59580eb363 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:27.721117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319e94-11e5-4faf-9228-fd59580eb363 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:27.722326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 676/1347] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:27.728332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c766-8199-4aa1-a6e8-7f47a2871fb1 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:27.728864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c766-8199-4aa1-a6e8-7f47a2871fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:27.728864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c766-8199-4aa1-a6e8-7f47a2871fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:27.799296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ff70c766-8199-4aa1-a6e8-7f47a2871fb1 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:27.800527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ff70c766-8199-4aa1-a6e8-7f47a2871fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:27.909885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:27.913012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 672/1348] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:23:28.199932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec319e94-11e5-4faf-9228-fd59580eb363 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:28.202784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ec319e94-11e5-4faf-9228-fd59580eb363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:28.341348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec319e94-11e5-4faf-9228-fd59580eb363 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:28.396926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:28.426095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7eff8c-803a-40d0-8143-c2929e2aacd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:28.426714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eff8c-803a-40d0-8143-c2929e2aacd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:28.426995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eff8c-803a-40d0-8143-c2929e2aacd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:28.427269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7eff8c-803a-40d0-8143-c2929e2aacd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:28.428909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9a7eff8c-803a-40d0-8143-c2929e2aacd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:28.558282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eff8c-803a-40d0-8143-c2929e2aacd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:28.559743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7eff8c-803a-40d0-8143-c2929e2aacd4 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:28.581009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 677/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:33.669174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f59bb-b970-4300-bf25-5a915e9119cc None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:33.670220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f59bb-b970-4300-bf25-5a915e9119cc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:33.670734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f59bb-b970-4300-bf25-5a915e9119cc None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:33.672574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 673/1350] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:33.680136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5afb-3552-473e-8821-77f5e65846a9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:33.680630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5afb-3552-473e-8821-77f5e65846a9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:33.680736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a5afb-3552-473e-8821-77f5e65846a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:33.784441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-686a5afb-3552-473e-8821-77f5e65846a9 None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:33.785936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-686a5afb-3552-473e-8821-77f5e65846a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:33.807755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:34.015779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 678/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:38.468808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e516-8d8e-4fd7-8c49-b16a92c9c2ab None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:38.469397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e516-8d8e-4fd7-8c49-b16a92c9c2ab None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:38.469397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e516-8d8e-4fd7-8c49-b16a92c9c2ab None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:38.470999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 674/1352] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:38.477077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9d76-9a54-4036-aeac-cda182af6833 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:38.477602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9d76-9a54-4036-aeac-cda182af6833 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:38.477704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9d76-9a54-4036-aeac-cda182af6833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:38.563939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-440b9d76-9a54-4036-aeac-cda182af6833 None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:38.565183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-440b9d76-9a54-4036-aeac-cda182af6833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:38.660592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:38.707924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 679/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:40.019180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fc51-905d-420a-aa75-22398477a13f None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:40.019745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fc51-905d-420a-aa75-22398477a13f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:40.019841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fc51-905d-420a-aa75-22398477a13f None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:40.021255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 675/1354] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:40.026845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573435a1-610f-4f46-af16-c8b9460728d2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:40.027290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573435a1-610f-4f46-af16-c8b9460728d2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:40.027402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573435a1-610f-4f46-af16-c8b9460728d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:40.109142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-573435a1-610f-4f46-af16-c8b9460728d2 None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:40.110359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-573435a1-610f-4f46-af16-c8b9460728d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:40.229841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 680/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:43.537172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6717218-44dd-4f4a-a178-6facede5d2fd None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:43.537971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6717218-44dd-4f4a-a178-6facede5d2fd None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:43.537971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6717218-44dd-4f4a-a178-6facede5d2fd None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:43.539331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 676/1356] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:43.545070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6a7f-73a7-40e6-ad7e-efb2d60a36be None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:43.545516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6a7f-73a7-40e6-ad7e-efb2d60a36be None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:43.545614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6a7f-73a7-40e6-ad7e-efb2d60a36be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:43.582074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:43.618710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f80b6a7f-73a7-40e6-ad7e-efb2d60a36be None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:43.618710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f80b6a7f-73a7-40e6-ad7e-efb2d60a36be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:43.749111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 681/1357] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:23:44.066564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e6e8-b4c8-4565-a224-53d771e09913 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:44.067098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e6e8-b4c8-4565-a224-53d771e09913 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:44.067371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e6e8-b4c8-4565-a224-53d771e09913 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:44.068712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 677/1358] 10.222.0.39 () {54 vars in 962 bytes} [Mon Sep 5 12:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:23:44.079145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91881-be78-4e16-81c5-f913719d30f6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:44.079448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91881-be78-4e16-81c5-f913719d30f6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:44.079735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91881-be78-4e16-81c5-f913719d30f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:44.170012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f8e91881-be78-4e16-81c5-f913719d30f6 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:44.172217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f8e91881-be78-4e16-81c5-f913719d30f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:44.237379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:44.312991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 682/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Sep 5 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:44.321021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80e6e8-b4c8-4565-a224-53d771e09913 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:44.322702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8a80e6e8-b4c8-4565-a224-53d771e09913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:44.477942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80e6e8-b4c8-4565-a224-53d771e09913 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:44.553183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:44.595282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6af973-f7cb-4409-bb5e-1ae954abe19c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:44.595909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6af973-f7cb-4409-bb5e-1ae954abe19c service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:44.596172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6af973-f7cb-4409-bb5e-1ae954abe19c service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:44.596436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6af973-f7cb-4409-bb5e-1ae954abe19c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:44.598051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3b6af973-f7cb-4409-bb5e-1ae954abe19c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:44.689576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6af973-f7cb-4409-bb5e-1ae954abe19c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:44.691180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6af973-f7cb-4409-bb5e-1ae954abe19c service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:44.709947 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 678/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:46.839969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da207d58-5bbd-42d6-afd9-93d06722b2eb None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:46.840436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da207d58-5bbd-42d6-afd9-93d06722b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:46.840518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da207d58-5bbd-42d6-afd9-93d06722b2eb None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:46.842095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 683/1361] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:46.846906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e704c5-4f5d-4627-b2c8-e24267fac52e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:46.847331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e704c5-4f5d-4627-b2c8-e24267fac52e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:46.847452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e704c5-4f5d-4627-b2c8-e24267fac52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:46.932015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b0e704c5-4f5d-4627-b2c8-e24267fac52e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:46.933349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b0e704c5-4f5d-4627-b2c8-e24267fac52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:46.974014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:47.039053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 679/1362] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:47.345312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da207d58-5bbd-42d6-afd9-93d06722b2eb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:47.347165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-da207d58-5bbd-42d6-afd9-93d06722b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:47.518239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da207d58-5bbd-42d6-afd9-93d06722b2eb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:47.528448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:47.644651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e4acb-17d2-4b69-91c0-a80ab893707d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:47.645293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e4acb-17d2-4b69-91c0-a80ab893707d service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:47.645576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e4acb-17d2-4b69-91c0-a80ab893707d service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:47.645852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e4acb-17d2-4b69-91c0-a80ab893707d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:47.647522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-938e4acb-17d2-4b69-91c0-a80ab893707d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:47.752189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e4acb-17d2-4b69-91c0-a80ab893707d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:47.753749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e4acb-17d2-4b69-91c0-a80ab893707d service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:47.774851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 684/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:50.273120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6a031-50a7-4a73-b720-858b66aed511 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:50.273755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6a031-50a7-4a73-b720-858b66aed511 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:50.273755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6a031-50a7-4a73-b720-858b66aed511 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:50.275043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 680/1364] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:50.280848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0871a-dc95-4617-87ac-2cf44d2c62b2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:50.281816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0871a-dc95-4617-87ac-2cf44d2c62b2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:50.282296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0871a-dc95-4617-87ac-2cf44d2c62b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:50.300074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:50.364719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1ba0871a-dc95-4617-87ac-2cf44d2c62b2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:50.366069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1ba0871a-dc95-4617-87ac-2cf44d2c62b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:50.489210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 685/1365] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:50.780860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f0fe-603e-49c6-90c8-810fc8a2ea08 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:50.781199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f0fe-603e-49c6-90c8-810fc8a2ea08 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:50.781465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f0fe-603e-49c6-90c8-810fc8a2ea08 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:50.783212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 681/1366] 10.222.0.39 () {54 vars in 962 bytes} [Mon Sep 5 12:23:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:50.790134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f5f6-2e6e-497d-9829-d687497ea985 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:50.790598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f5f6-2e6e-497d-9829-d687497ea985 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:50.790776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f5f6-2e6e-497d-9829-d687497ea985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:50.893453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c9e8f5f6-2e6e-497d-9829-d687497ea985 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:50.894769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c9e8f5f6-2e6e-497d-9829-d687497ea985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:50.934633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:51.034628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 686/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Sep 5 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:51.043793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20f0fe-603e-49c6-90c8-810fc8a2ea08 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:51.045476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-eb20f0fe-603e-49c6-90c8-810fc8a2ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:51.215414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20f0fe-603e-49c6-90c8-810fc8a2ea08 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:51.240252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:51.365777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80fb8d-049c-438a-a724-c6197f6846db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:51.367019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80fb8d-049c-438a-a724-c6197f6846db service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:51.367316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80fb8d-049c-438a-a724-c6197f6846db service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:51.367809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80fb8d-049c-438a-a724-c6197f6846db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:51.373061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-fe80fb8d-049c-438a-a724-c6197f6846db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:51.482398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80fb8d-049c-438a-a724-c6197f6846db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:51.488210 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80fb8d-049c-438a-a724-c6197f6846db service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:51.507406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 682/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:52.076495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10be6f-57b1-40b9-afa2-d3f107bbca1b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:52.077094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10be6f-57b1-40b9-afa2-d3f107bbca1b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:52.077094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10be6f-57b1-40b9-afa2-d3f107bbca1b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:52.078740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 687/1369] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:23:52.084707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35580146-6a1a-473a-b63e-bbe4bedec474 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:52.085817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35580146-6a1a-473a-b63e-bbe4bedec474 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:52.086303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35580146-6a1a-473a-b63e-bbe4bedec474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:52.131031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:52.173205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-35580146-6a1a-473a-b63e-bbe4bedec474 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:52.174545 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-35580146-6a1a-473a-b63e-bbe4bedec474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:52.298672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 683/1370] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:52.916300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfed667-2498-49ee-a09e-750091f82946 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:52.916300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfed667-2498-49ee-a09e-750091f82946 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:52.916300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfed667-2498-49ee-a09e-750091f82946 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:52.917999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 688/1371] 10.222.0.39 () {54 vars in 964 bytes} [Mon Sep 5 12:23:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:52.928360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b8e0-1f10-4aac-a4dc-12d6a78d1899 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:52.929738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b8e0-1f10-4aac-a4dc-12d6a78d1899 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:52.929738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0b8e0-1f10-4aac-a4dc-12d6a78d1899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:53.016844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e1a0b8e0-1f10-4aac-a4dc-12d6a78d1899 None None] MFA Rules not processed for user `77ae8a6fe7ff4190aa3cd8c7f820d15b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:53.018122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e1a0b8e0-1f10-4aac-a4dc-12d6a78d1899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:53.070726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:53.105439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 684/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Sep 5 12:23:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:53.113743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfed667-2498-49ee-a09e-750091f82946 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:53.115428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bcfed667-2498-49ee-a09e-750091f82946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:53.255018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfed667-2498-49ee-a09e-750091f82946 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:53.307946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:53.344890 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f869c1-82d5-4c6d-a831-8215f9946551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:53.345535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f869c1-82d5-4c6d-a831-8215f9946551 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:53.345888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f869c1-82d5-4c6d-a831-8215f9946551 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:53.346088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f869c1-82d5-4c6d-a831-8215f9946551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:53.347700 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-88f869c1-82d5-4c6d-a831-8215f9946551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:53.480418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f869c1-82d5-4c6d-a831-8215f9946551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:53.481886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f869c1-82d5-4c6d-a831-8215f9946551 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:53.502862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 689/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:53.950224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b818-4fd6-48a0-b852-4ac279332e97 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:53.951183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b818-4fd6-48a0-b852-4ac279332e97 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:53.951680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b818-4fd6-48a0-b852-4ac279332e97 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:53.953683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 685/1374] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:53.962412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb262-b9d5-408a-9142-315ae36326d3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:53.962984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb262-b9d5-408a-9142-315ae36326d3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:53.963576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bb262-b9d5-408a-9142-315ae36326d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:54.034263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fb2bb262-b9d5-408a-9142-315ae36326d3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:54.035500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fb2bb262-b9d5-408a-9142-315ae36326d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:54.059282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:54.142374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 690/1375] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:23:54.449572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6b818-4fd6-48a0-b852-4ac279332e97 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:54.450776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f0e6b818-4fd6-48a0-b852-4ac279332e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:54.616611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6b818-4fd6-48a0-b852-4ac279332e97 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:54.671313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:54.739245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb4fd-5bd7-42d7-9376-4b3a98faf4cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:54.739981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb4fd-5bd7-42d7-9376-4b3a98faf4cd service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:54.740343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb4fd-5bd7-42d7-9376-4b3a98faf4cd service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:54.740684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb4fd-5bd7-42d7-9376-4b3a98faf4cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:54.743121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-576eb4fd-5bd7-42d7-9376-4b3a98faf4cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:54.853715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb4fd-5bd7-42d7-9376-4b3a98faf4cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:54.855356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb4fd-5bd7-42d7-9376-4b3a98faf4cd service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:54.876745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 686/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:57.046909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3254f8-fc8b-472e-940e-e1d69f00116e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:57.047441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3254f8-fc8b-472e-940e-e1d69f00116e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:57.047441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3254f8-fc8b-472e-940e-e1d69f00116e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:57.048746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 691/1377] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:57.054589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92c20b-e204-44f6-aa00-8a6ddfc90d0e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:57.055049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92c20b-e204-44f6-aa00-8a6ddfc90d0e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:57.055148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92c20b-e204-44f6-aa00-8a6ddfc90d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:57.123544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6e92c20b-e204-44f6-aa00-8a6ddfc90d0e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:57.124858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6e92c20b-e204-44f6-aa00-8a6ddfc90d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:57.131635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:57.237538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 687/1378] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:23:57.538836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3254f8-fc8b-472e-940e-e1d69f00116e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:57.540339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7e3254f8-fc8b-472e-940e-e1d69f00116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:57.700176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3254f8-fc8b-472e-940e-e1d69f00116e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:57.704258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:57.820132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee270a6-70d8-42b6-a919-04b28097f8f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:57.820642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee270a6-70d8-42b6-a919-04b28097f8f4 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:57.820923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee270a6-70d8-42b6-a919-04b28097f8f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:57.821217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee270a6-70d8-42b6-a919-04b28097f8f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:57.822787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bee270a6-70d8-42b6-a919-04b28097f8f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:57.930686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee270a6-70d8-42b6-a919-04b28097f8f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:57.932339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee270a6-70d8-42b6-a919-04b28097f8f4 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:57.952187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 692/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:00.167704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb929-4fd2-48ba-9983-14ecd286a9cc None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:00.168338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb929-4fd2-48ba-9983-14ecd286a9cc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:00.168710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cb929-4fd2-48ba-9983-14ecd286a9cc None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:00.170198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 688/1380] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:00.176485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f73bd8-2a9c-4c43-9de0-0a5c99d8d5b0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:00.177120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f73bd8-2a9c-4c43-9de0-0a5c99d8d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:00.177120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f73bd8-2a9c-4c43-9de0-0a5c99d8d5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:00.190304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:00.259307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-81f73bd8-2a9c-4c43-9de0-0a5c99d8d5b0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:00.260546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-81f73bd8-2a9c-4c43-9de0-0a5c99d8d5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:00.365813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 693/1381] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:00.671349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cb929-4fd2-48ba-9983-14ecd286a9cc None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:00.673269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9f8cb929-4fd2-48ba-9983-14ecd286a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:00.822538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:00.843192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cb929-4fd2-48ba-9983-14ecd286a9cc None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:00.963439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a040bbc-3127-4bc3-bf80-125d98c4a125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:00.964133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040bbc-3127-4bc3-bf80-125d98c4a125 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:00.964520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040bbc-3127-4bc3-bf80-125d98c4a125 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:00.965815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a040bbc-3127-4bc3-bf80-125d98c4a125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:00.967581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0a040bbc-3127-4bc3-bf80-125d98c4a125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:01.068358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a040bbc-3127-4bc3-bf80-125d98c4a125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:01.070678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a040bbc-3127-4bc3-bf80-125d98c4a125 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:01.081692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:01.091857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 689/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:03.531338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530e6e5-d565-4a87-b1f8-f2644fc36b8a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.531997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530e6e5-d565-4a87-b1f8-f2644fc36b8a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.531997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530e6e5-d565-4a87-b1f8-f2644fc36b8a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.533389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 694/1383] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:03.540485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004f15e-e0fb-4524-85d9-5fedeb8968bc None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.541073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004f15e-e0fb-4524-85d9-5fedeb8968bc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.541073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004f15e-e0fb-4524-85d9-5fedeb8968bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.622623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0004f15e-e0fb-4524-85d9-5fedeb8968bc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:03.624138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0004f15e-e0fb-4524-85d9-5fedeb8968bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:03.730340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 690/1384] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:04.121830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530e6e5-d565-4a87-b1f8-f2644fc36b8a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:04.124084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f530e6e5-d565-4a87-b1f8-f2644fc36b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:04.232319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:04.321484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530e6e5-d565-4a87-b1f8-f2644fc36b8a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:04.471999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad818fd-8c2f-4cd4-b225-ca1076b78b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:04.472531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad818fd-8c2f-4cd4-b225-ca1076b78b46 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:04.472823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad818fd-8c2f-4cd4-b225-ca1076b78b46 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:04.473135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad818fd-8c2f-4cd4-b225-ca1076b78b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:04.474762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0ad818fd-8c2f-4cd4-b225-ca1076b78b46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:04.529224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:04.573060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad818fd-8c2f-4cd4-b225-ca1076b78b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:04.574706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad818fd-8c2f-4cd4-b225-ca1076b78b46 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:04.593482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 695/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:06.593524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcc363-09b9-4d63-b3cb-21001bfca8ad None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:06.594087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcc363-09b9-4d63-b3cb-21001bfca8ad None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:06.594087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcc363-09b9-4d63-b3cb-21001bfca8ad None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:06.595446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 691/1386] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:06.601970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80d029-7083-4e6c-ae8c-f9fcb79072b7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:06.602496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80d029-7083-4e6c-ae8c-f9fcb79072b7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:06.602606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80d029-7083-4e6c-ae8c-f9fcb79072b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:06.681317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ed80d029-7083-4e6c-ae8c-f9fcb79072b7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:06.682923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ed80d029-7083-4e6c-ae8c-f9fcb79072b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:06.795488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 696/1387] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:07.093416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcc363-09b9-4d63-b3cb-21001bfca8ad None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:07.094962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-24bcc363-09b9-4d63-b3cb-21001bfca8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:07.197031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:07.273317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcc363-09b9-4d63-b3cb-21001bfca8ad None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:07.394179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051299dd-0d17-4180-abba-08ec289294b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:07.394807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051299dd-0d17-4180-abba-08ec289294b1 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:07.395068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051299dd-0d17-4180-abba-08ec289294b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:07.395339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051299dd-0d17-4180-abba-08ec289294b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:07.397472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-051299dd-0d17-4180-abba-08ec289294b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:07.441522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:07.510363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051299dd-0d17-4180-abba-08ec289294b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:07.512062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051299dd-0d17-4180-abba-08ec289294b1 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:07.531767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 692/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:09.138782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529e796-818e-4fe1-b0f3-952982f55b62 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.140579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529e796-818e-4fe1-b0f3-952982f55b62 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.140579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529e796-818e-4fe1-b0f3-952982f55b62 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.141534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 697/1389] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:09.147629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63050b-7c17-4077-ae0f-fd0647803dc8 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.148152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63050b-7c17-4077-ae0f-fd0647803dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.148336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63050b-7c17-4077-ae0f-fd0647803dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.225598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ec63050b-7c17-4077-ae0f-fd0647803dc8 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:09.225598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ec63050b-7c17-4077-ae0f-fd0647803dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:09.343877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 693/1390] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:09.660739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcdca1-5527-43a7-b81b-89b2f72a1188 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.661146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcdca1-5527-43a7-b81b-89b2f72a1188 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.661608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcdca1-5527-43a7-b81b-89b2f72a1188 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.663975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 698/1391] 10.222.0.39 () {54 vars in 961 bytes} [Mon Sep 5 12:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:09.669466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669f0e-9cc7-4f62-9373-1626b9957d84 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.669757 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669f0e-9cc7-4f62-9373-1626b9957d84 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.670031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11669f0e-9cc7-4f62-9373-1626b9957d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.670137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b938a-c16d-4c59-9fe4-e8784cdeaaa6 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.670417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b938a-c16d-4c59-9fe4-e8784cdeaaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.670687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b938a-c16d-4c59-9fe4-e8784cdeaaa6 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.672154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 699/1392] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:24:09.677780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb80e6-f7ba-4c1d-a098-7315cbea4fe5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.678639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb80e6-f7ba-4c1d-a098-7315cbea4fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.678913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb80e6-f7ba-4c1d-a098-7315cbea4fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.687307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:09.721490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:09.754014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-11669f0e-9cc7-4f62-9373-1626b9957d84 None None] MFA Rules not processed for user `66a29dd8d28f44f0b311d167fd39b4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:09.754727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5acb80e6-f7ba-4c1d-a098-7315cbea4fe5 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:09.755429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-11669f0e-9cc7-4f62-9373-1626b9957d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:09.755916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5acb80e6-f7ba-4c1d-a098-7315cbea4fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:09.841221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 694/1393] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Sep 5 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:09.848730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11669f0e-9cc7-4f62-9373-1626b9957d84 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:09.856361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11669f0e-9cc7-4f62-9373-1626b9957d84 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:09.859138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 700/1394] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:09.934027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26327acb-4fba-43c5-bc97-e8fb7bdf984d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a29dd8d28f44f0b311d167fd39b4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:09.934552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26327acb-4fba-43c5-bc97-e8fb7bdf984d service glance] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.934832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26327acb-4fba-43c5-bc97-e8fb7bdf984d service glance] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.935100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26327acb-4fba-43c5-bc97-e8fb7bdf984d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.936739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-26327acb-4fba-43c5-bc97-e8fb7bdf984d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:09.967470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:10.048500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26327acb-4fba-43c5-bc97-e8fb7bdf984d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.049955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26327acb-4fba-43c5-bc97-e8fb7bdf984d service glance] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.069484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 695/1395] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:24:10.156454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb80e6-f7ba-4c1d-a098-7315cbea4fe5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.157742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5acb80e6-f7ba-4c1d-a098-7315cbea4fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:10.267416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:10.277471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb80e6-f7ba-4c1d-a098-7315cbea4fe5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.403032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98676b-bffc-4ed1-986e-a29bf30fdddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.403642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98676b-bffc-4ed1-986e-a29bf30fdddd service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.403922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98676b-bffc-4ed1-986e-a29bf30fdddd service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.404194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98676b-bffc-4ed1-986e-a29bf30fdddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.405818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0e98676b-bffc-4ed1-986e-a29bf30fdddd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:10.507599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98676b-bffc-4ed1-986e-a29bf30fdddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.509143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98676b-bffc-4ed1-986e-a29bf30fdddd service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.525489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:10.529492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 701/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:11.027913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e94c1-edbb-41d4-b36f-7dba72780948 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.028436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e94c1-edbb-41d4-b36f-7dba72780948 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.028550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e94c1-edbb-41d4-b36f-7dba72780948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.104083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b83e94c1-edbb-41d4-b36f-7dba72780948 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:11.105398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b83e94c1-edbb-41d4-b36f-7dba72780948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:11.188729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:11.195312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 696/1397] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:11.243499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb3590-349d-479e-a7b1-cd6f59f93804 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.244035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb3590-349d-479e-a7b1-cd6f59f93804 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.244147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb3590-349d-479e-a7b1-cd6f59f93804 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.245509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 702/1398] 10.222.0.39 () {54 vars in 943 bytes} [Mon Sep 5 12:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:24:11.252144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce82ae-d007-400d-9ddd-b5ca21928c90 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.252437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce82ae-d007-400d-9ddd-b5ca21928c90 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.252710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce82ae-d007-400d-9ddd-b5ca21928c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.341072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6dce82ae-d007-400d-9ddd-b5ca21928c90 None None] MFA Rules not processed for user `939c785e259f445a97c737152ae96a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:11.342369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6dce82ae-d007-400d-9ddd-b5ca21928c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:11.454003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 697/1399] 10.222.0.39 () {58 vars in 1040 bytes} [Mon Sep 5 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:11.463347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb3590-349d-479e-a7b1-cd6f59f93804 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:11.464965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4fbb3590-349d-479e-a7b1-cd6f59f93804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:11.605989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb3590-349d-479e-a7b1-cd6f59f93804 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:11.691845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:11.711120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d34073-9675-4b96-a1d8-9db87167fdf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:11.711652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d34073-9675-4b96-a1d8-9db87167fdf1 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.711929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d34073-9675-4b96-a1d8-9db87167fdf1 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.712198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d34073-9675-4b96-a1d8-9db87167fdf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.713857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-74d34073-9675-4b96-a1d8-9db87167fdf1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:11.801946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d34073-9675-4b96-a1d8-9db87167fdf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:11.803663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d34073-9675-4b96-a1d8-9db87167fdf1 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:11.812941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 703/1400] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:24:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:24:12.644231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb171d4-0bfd-4ab4-9f73-a1974c117da6 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.644836 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb171d4-0bfd-4ab4-9f73-a1974c117da6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.645220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb171d4-0bfd-4ab4-9f73-a1974c117da6 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.648360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 698/1401] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:12.653995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd65bd-c0f4-428e-9470-106e1c5a1cab None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.654505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd65bd-c0f4-428e-9470-106e1c5a1cab None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.654605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd65bd-c0f4-428e-9470-106e1c5a1cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.723664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d1fd65bd-c0f4-428e-9470-106e1c5a1cab None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:12.725589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d1fd65bd-c0f4-428e-9470-106e1c5a1cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:12.801975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:12.834402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 704/1402] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:13.131012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb171d4-0bfd-4ab4-9f73-a1974c117da6 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.132601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4fb171d4-0bfd-4ab4-9f73-a1974c117da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:13.203436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:13.309178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb171d4-0bfd-4ab4-9f73-a1974c117da6 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.442414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d1423-6ab5-4057-97c9-9c59271c2d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.443029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1423-6ab5-4057-97c9-9c59271c2d3a service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.443309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1423-6ab5-4057-97c9-9c59271c2d3a service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.444145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d1423-6ab5-4057-97c9-9c59271c2d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.448696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-219d1423-6ab5-4057-97c9-9c59271c2d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:13.466836 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:13.562612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d1423-6ab5-4057-97c9-9c59271c2d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.564698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d1423-6ab5-4057-97c9-9c59271c2d3a service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.587232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 699/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:15.742389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208435-25f4-49cf-ac3c-e83a4e103f3d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:15.742990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208435-25f4-49cf-ac3c-e83a4e103f3d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:15.742990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208435-25f4-49cf-ac3c-e83a4e103f3d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:15.744276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 705/1404] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:15.749772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e846-a8be-4591-9b6d-7aeba6d60f5c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:15.752075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e846-a8be-4591-9b6d-7aeba6d60f5c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:15.752075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e846-a8be-4591-9b6d-7aeba6d60f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:15.832178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-af14e846-a8be-4591-9b6d-7aeba6d60f5c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:15.834503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-af14e846-a8be-4591-9b6d-7aeba6d60f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:15.943088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:15.953625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 700/1405] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:16.247034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e208435-25f4-49cf-ac3c-e83a4e103f3d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:16.248569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9e208435-25f4-49cf-ac3c-e83a4e103f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:16.414223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e208435-25f4-49cf-ac3c-e83a4e103f3d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:16.478882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:16.547424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7c64d-4277-4d34-b720-0e5404eec04e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:16.547948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7c64d-4277-4d34-b720-0e5404eec04e service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:16.548231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7c64d-4277-4d34-b720-0e5404eec04e service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:16.548611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7c64d-4277-4d34-b720-0e5404eec04e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:16.550302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8ea7c64d-4277-4d34-b720-0e5404eec04e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:16.660750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7c64d-4277-4d34-b720-0e5404eec04e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:16.663901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7c64d-4277-4d34-b720-0e5404eec04e service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:16.685467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 706/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:18.852753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b750f5-5255-4575-bf3a-4c4011cd3c6e None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:18.853305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b750f5-5255-4575-bf3a-4c4011cd3c6e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:18.853429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b750f5-5255-4575-bf3a-4c4011cd3c6e None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:18.854753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 701/1407] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:18.860156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cad708-9837-418a-9e7d-5b573dca3b7c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:18.860654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cad708-9837-418a-9e7d-5b573dca3b7c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:18.860823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cad708-9837-418a-9e7d-5b573dca3b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:18.941847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-29cad708-9837-418a-9e7d-5b573dca3b7c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:18.943077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-29cad708-9837-418a-9e7d-5b573dca3b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:18.962582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:19.058373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 707/1408] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:19.354190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b750f5-5255-4575-bf3a-4c4011cd3c6e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:19.355745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-66b750f5-5255-4575-bf3a-4c4011cd3c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:19.533723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b750f5-5255-4575-bf3a-4c4011cd3c6e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:19.632246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:19.691431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3dd9-d6c4-40c0-ac18-186b3e1f34fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:19.692194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3dd9-d6c4-40c0-ac18-186b3e1f34fe service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.692361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3dd9-d6c4-40c0-ac18-186b3e1f34fe service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.692651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3dd9-d6c4-40c0-ac18-186b3e1f34fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.695016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-83bc3dd9-d6c4-40c0-ac18-186b3e1f34fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:19.807160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3dd9-d6c4-40c0-ac18-186b3e1f34fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:19.809111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3dd9-d6c4-40c0-ac18-186b3e1f34fe service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:19.832076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 702/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:29.056602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=37 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:29.825668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=65 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:35.781519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493291-c0a4-4bb2-a868-306e3219be1d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:35.782220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493291-c0a4-4bb2-a868-306e3219be1d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:35.782220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03493291-c0a4-4bb2-a868-306e3219be1d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:35.783399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 708/1410] 10.222.0.39 () {54 vars in 918 bytes} [Mon Sep 5 12:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:35.788813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b516f55-9473-4f33-be2e-01ec118cb452 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:35.789308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b516f55-9473-4f33-be2e-01ec118cb452 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:35.789456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b516f55-9473-4f33-be2e-01ec118cb452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:35.865174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0b516f55-9473-4f33-be2e-01ec118cb452 None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:35.866946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0b516f55-9473-4f33-be2e-01ec118cb452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:35.978124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 703/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Sep 5 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:35.993231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26a962-a71c-450a-86f9-9b0a12a6d970 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:35.993520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26a962-a71c-450a-86f9-9b0a12a6d970 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:35.993819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26a962-a71c-450a-86f9-9b0a12a6d970 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:35.995124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 709/1412] 10.222.0.39 () {54 vars in 918 bytes} [Mon Sep 5 12:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:35.999936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba496d-b037-400e-9e52-a2da8713024c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.000229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba496d-b037-400e-9e52-a2da8713024c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.000508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba496d-b037-400e-9e52-a2da8713024c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.073794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:36.076896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e3ba496d-b037-400e-9e52-a2da8713024c None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:36.078154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e3ba496d-b037-400e-9e52-a2da8713024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:36.191936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 704/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Sep 5 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:38.593842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481a5d-53c2-4fa1-848c-48e8a1f6de60 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:38.594636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481a5d-53c2-4fa1-848c-48e8a1f6de60 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:38.594636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481a5d-53c2-4fa1-848c-48e8a1f6de60 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:38.596335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:38.602303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7085c7-d286-4b45-80ae-df6a09c05d0a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:38.602754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7085c7-d286-4b45-80ae-df6a09c05d0a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:38.602862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7085c7-d286-4b45-80ae-df6a09c05d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:38.669410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1f7085c7-d286-4b45-80ae-df6a09c05d0a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:38.670628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1f7085c7-d286-4b45-80ae-df6a09c05d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:38.724391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:38.767503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:39.057843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a481a5d-53c2-4fa1-848c-48e8a1f6de60 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:39.059427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1a481a5d-53c2-4fa1-848c-48e8a1f6de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:39.206385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a481a5d-53c2-4fa1-848c-48e8a1f6de60 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:39.277943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:39.319012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a9940-bd06-454a-9645-e70e8c1d8121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:39.319630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a9940-bd06-454a-9645-e70e8c1d8121 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:39.319914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a9940-bd06-454a-9645-e70e8c1d8121 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:39.320208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a9940-bd06-454a-9645-e70e8c1d8121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:39.321835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-831a9940-bd06-454a-9645-e70e8c1d8121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:39.412075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a9940-bd06-454a-9645-e70e8c1d8121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:39.414089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a9940-bd06-454a-9645-e70e8c1d8121 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:39.432026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 711/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:40.344899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd909-49ae-4bbf-b4ee-353e3365ff12 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:40.345470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd909-49ae-4bbf-b4ee-353e3365ff12 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:40.345563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd909-49ae-4bbf-b4ee-353e3365ff12 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:40.346870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:24:40.352351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099ed0-c938-49f2-b418-109ec553add4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:40.352751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099ed0-c938-49f2-b418-109ec553add4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:40.352875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099ed0-c938-49f2-b418-109ec553add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:40.440307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-76099ed0-c938-49f2-b418-109ec553add4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:40.441596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-76099ed0-c938-49f2-b418-109ec553add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:40.469819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:40.539639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:40.691775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd909-49ae-4bbf-b4ee-353e3365ff12 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:40.693298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c97cd909-49ae-4bbf-b4ee-353e3365ff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:40.841576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd909-49ae-4bbf-b4ee-353e3365ff12 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:40.882134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:40.954507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff61d0a-4557-4bfd-adeb-784c17bf5346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:40.955052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61d0a-4557-4bfd-adeb-784c17bf5346 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:40.955305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61d0a-4557-4bfd-adeb-784c17bf5346 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:40.955624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff61d0a-4557-4bfd-adeb-784c17bf5346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:40.957266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2ff61d0a-4557-4bfd-adeb-784c17bf5346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:41.044513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61d0a-4557-4bfd-adeb-784c17bf5346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:41.046122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff61d0a-4557-4bfd-adeb-784c17bf5346 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:41.063657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 707/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:41.971723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5610e-a4c0-4001-8bd9-262491aedceb None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:41.972308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5610e-a4c0-4001-8bd9-262491aedceb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:41.972308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5610e-a4c0-4001-8bd9-262491aedceb None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:41.973706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:41.979415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eea76-51bd-497c-9efa-53a4fed23d97 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:41.979849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eea76-51bd-497c-9efa-53a4fed23d97 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:41.979959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eea76-51bd-497c-9efa-53a4fed23d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:42.038217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:42.072012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-514eea76-51bd-497c-9efa-53a4fed23d97 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:42.074042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-514eea76-51bd-497c-9efa-53a4fed23d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:42.171197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:42.321152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5610e-a4c0-4001-8bd9-262491aedceb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:42.322702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9be5610e-a4c0-4001-8bd9-262491aedceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:42.468190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5610e-a4c0-4001-8bd9-262491aedceb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:42.480125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:42.581450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48677e6b-9ff4-41f9-8228-80cef8a68d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:42.582056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677e6b-9ff4-41f9-8228-80cef8a68d3a service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:42.582340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677e6b-9ff4-41f9-8228-80cef8a68d3a service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:42.582617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48677e6b-9ff4-41f9-8228-80cef8a68d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:42.584815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-48677e6b-9ff4-41f9-8228-80cef8a68d3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:42.674242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48677e6b-9ff4-41f9-8228-80cef8a68d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:42.675840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48677e6b-9ff4-41f9-8228-80cef8a68d3a service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:42.695178 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 714/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:43.587707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73906-2c49-45e1-b685-30661d939682 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:43.588304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73906-2c49-45e1-b685-30661d939682 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:43.588304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73906-2c49-45e1-b685-30661d939682 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:43.589662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:43.594459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446c26-52d6-48ec-b394-811f12c29a10 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:43.594900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446c26-52d6-48ec-b394-811f12c29a10 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:43.595018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2446c26-52d6-48ec-b394-811f12c29a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:43.616743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:43.674940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b2446c26-52d6-48ec-b394-811f12c29a10 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:43.676154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b2446c26-52d6-48ec-b394-811f12c29a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:43.774120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:43.939342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73906-2c49-45e1-b685-30661d939682 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:43.940857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a6b73906-2c49-45e1-b685-30661d939682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:44.055127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:44.091956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73906-2c49-45e1-b685-30661d939682 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:44.204254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e45275-493f-4bf0-a41f-a4f2a954965a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:44.204865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45275-493f-4bf0-a41f-a4f2a954965a service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:44.205166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45275-493f-4bf0-a41f-a4f2a954965a service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:44.205439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e45275-493f-4bf0-a41f-a4f2a954965a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:44.207017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-09e45275-493f-4bf0-a41f-a4f2a954965a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:44.283215 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:44.296844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e45275-493f-4bf0-a41f-a4f2a954965a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:44.298508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e45275-493f-4bf0-a41f-a4f2a954965a service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:44.316657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 710/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:45.189634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6386c-c577-4f03-9d5c-1e45cd9b2c27 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:45.190219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6386c-c577-4f03-9d5c-1e45cd9b2c27 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:45.190219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6386c-c577-4f03-9d5c-1e45cd9b2c27 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:45.191615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:45.200647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70fb4-7124-4ffe-b350-92e87e612563 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:45.200647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70fb4-7124-4ffe-b350-92e87e612563 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:45.200647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70fb4-7124-4ffe-b350-92e87e612563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:45.281447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-63f70fb4-7124-4ffe-b350-92e87e612563 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:45.282677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-63f70fb4-7124-4ffe-b350-92e87e612563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:45.381491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:45.532782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6386c-c577-4f03-9d5c-1e45cd9b2c27 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:45.534251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3ec6386c-c577-4f03-9d5c-1e45cd9b2c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:45.737901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:45.799310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6386c-c577-4f03-9d5c-1e45cd9b2c27 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:45.923659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794ed86-5ad6-4620-a0d4-915fc8d8b1ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:45.924275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ed86-5ad6-4620-a0d4-915fc8d8b1ff service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:45.924558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ed86-5ad6-4620-a0d4-915fc8d8b1ff service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:45.924834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794ed86-5ad6-4620-a0d4-915fc8d8b1ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:45.926485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5794ed86-5ad6-4620-a0d4-915fc8d8b1ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:45.977829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:46.019165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794ed86-5ad6-4620-a0d4-915fc8d8b1ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:46.020881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794ed86-5ad6-4620-a0d4-915fc8d8b1ff service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:46.039513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 717/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:46.936924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cf705-6a44-4eb9-9c37-c2ff73bdb7a1 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:46.937516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cf705-6a44-4eb9-9c37-c2ff73bdb7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:46.937516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cf705-6a44-4eb9-9c37-c2ff73bdb7a1 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:46.938846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:46.944321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b26487-8eb7-41eb-8389-a651a8425d83 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:46.944761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b26487-8eb7-41eb-8389-a651a8425d83 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:46.944859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b26487-8eb7-41eb-8389-a651a8425d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:47.019951 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c4b26487-8eb7-41eb-8389-a651a8425d83 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:47.021190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c4b26487-8eb7-41eb-8389-a651a8425d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:47.116330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:47.268169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cf705-6a44-4eb9-9c37-c2ff73bdb7a1 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:47.269761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-fe6cf705-6a44-4eb9-9c37-c2ff73bdb7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:47.318138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:47.416909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cf705-6a44-4eb9-9c37-c2ff73bdb7a1 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:47.527984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcca44-f126-47c2-af83-07b14f2244d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:47.528592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcca44-f126-47c2-af83-07b14f2244d6 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:47.528872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcca44-f126-47c2-af83-07b14f2244d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:47.529176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcca44-f126-47c2-af83-07b14f2244d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:47.530790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e4dcca44-f126-47c2-af83-07b14f2244d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:47.538174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:47.621123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcca44-f126-47c2-af83-07b14f2244d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:47.622740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcca44-f126-47c2-af83-07b14f2244d6 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:47.640527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 713/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:48.509872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21629f3-460c-4160-bee9-b11c4e982f7a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:48.510462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21629f3-460c-4160-bee9-b11c4e982f7a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:48.510462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21629f3-460c-4160-bee9-b11c4e982f7a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:48.511794 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:48.516941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532da1d-aa67-470a-873e-1b9f622e9780 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:48.517379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532da1d-aa67-470a-873e-1b9f622e9780 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:48.517563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532da1d-aa67-470a-873e-1b9f622e9780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:48.593279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1532da1d-aa67-470a-873e-1b9f622e9780 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:48.594498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1532da1d-aa67-470a-873e-1b9f622e9780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:48.663020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:48.692715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:48.842560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21629f3-460c-4160-bee9-b11c4e982f7a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:48.844202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a21629f3-460c-4160-bee9-b11c4e982f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:48.863152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:48.992992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21629f3-460c-4160-bee9-b11c4e982f7a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.078030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:49.103261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170bcec-99de-4b87-b335-41bac7781735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.103863 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170bcec-99de-4b87-b335-41bac7781735 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.104143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170bcec-99de-4b87-b335-41bac7781735 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.104416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170bcec-99de-4b87-b335-41bac7781735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.106031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4170bcec-99de-4b87-b335-41bac7781735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:49.200667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170bcec-99de-4b87-b335-41bac7781735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.202285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170bcec-99de-4b87-b335-41bac7781735 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.220451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 720/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:50.136923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3858de-bb51-4f99-913d-dfff1599deef None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.137496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3858de-bb51-4f99-913d-dfff1599deef None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.137496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3858de-bb51-4f99-913d-dfff1599deef None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.138849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:50.143662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4935d1a-0d44-4e18-afdc-8dbdd78793d3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.144122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4935d1a-0d44-4e18-afdc-8dbdd78793d3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.144370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4935d1a-0d44-4e18-afdc-8dbdd78793d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.221445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e4935d1a-0d44-4e18-afdc-8dbdd78793d3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:50.222708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e4935d1a-0d44-4e18-afdc-8dbdd78793d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:50.264694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:50.320028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:50.471035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3858de-bb51-4f99-913d-dfff1599deef None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.472487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7d3858de-bb51-4f99-913d-dfff1599deef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:50.623369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3858de-bb51-4f99-913d-dfff1599deef None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.680693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:50.740732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0868a65-9d0e-41e9-98a2-7e6e5431640c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.741287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868a65-9d0e-41e9-98a2-7e6e5431640c service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.741566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868a65-9d0e-41e9-98a2-7e6e5431640c service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.741843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0868a65-9d0e-41e9-98a2-7e6e5431640c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.743460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b0868a65-9d0e-41e9-98a2-7e6e5431640c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:50.835321 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0868a65-9d0e-41e9-98a2-7e6e5431640c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:50.836985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0868a65-9d0e-41e9-98a2-7e6e5431640c service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:50.856227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 716/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:51.731518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2db6-e79a-4cf2-8f8d-6716b3f7262c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.732114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2db6-e79a-4cf2-8f8d-6716b3f7262c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.732114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c2db6-e79a-4cf2-8f8d-6716b3f7262c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.733437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:51.738334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b335695-c6a8-420d-90e8-64fb826401a2 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.738828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b335695-c6a8-420d-90e8-64fb826401a2 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.738951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b335695-c6a8-420d-90e8-64fb826401a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.814801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1b335695-c6a8-420d-90e8-64fb826401a2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:51.816025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1b335695-c6a8-420d-90e8-64fb826401a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:51.818730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:51.939763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:52.089168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c2db6-e79a-4cf2-8f8d-6716b3f7262c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:52.090713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bc7c2db6-e79a-4cf2-8f8d-6716b3f7262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:52.251934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c2db6-e79a-4cf2-8f8d-6716b3f7262c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:52.278367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:52.365059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c0e97-3010-41fa-ad0a-0da50035c702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:52.365664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c0e97-3010-41fa-ad0a-0da50035c702 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:52.365941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c0e97-3010-41fa-ad0a-0da50035c702 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:52.366207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c0e97-3010-41fa-ad0a-0da50035c702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:52.367817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dc8c0e97-3010-41fa-ad0a-0da50035c702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:52.456558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c0e97-3010-41fa-ad0a-0da50035c702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:52.458192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c0e97-3010-41fa-ad0a-0da50035c702 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:52.475898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 723/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:54.336477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad4e4-d9c4-43b4-b8dd-5a5301320e3b None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:54.337059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad4e4-d9c4-43b4-b8dd-5a5301320e3b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:54.337059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ad4e4-d9c4-43b4-b8dd-5a5301320e3b None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:54.338420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:54.344046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f877-1e5a-4553-85b9-be13e641c0d9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:54.344552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f877-1e5a-4553-85b9-be13e641c0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:54.344651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428f877-1e5a-4553-85b9-be13e641c0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:54.387953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:54.415674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0428f877-1e5a-4553-85b9-be13e641c0d9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:54.416983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0428f877-1e5a-4553-85b9-be13e641c0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:54.518816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:54.811635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad4e4-d9c4-43b4-b8dd-5a5301320e3b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:54.813244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1e4ad4e4-d9c4-43b4-b8dd-5a5301320e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:54.961539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ad4e4-d9c4-43b4-b8dd-5a5301320e3b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:55.005238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:55.052164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a46d8-34bf-48d8-ba15-f6a3c63261b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:55.053028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a46d8-34bf-48d8-ba15-f6a3c63261b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:55.053399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a46d8-34bf-48d8-ba15-f6a3c63261b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:55.053680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a46d8-34bf-48d8-ba15-f6a3c63261b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:55.055460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1f4a46d8-34bf-48d8-ba15-f6a3c63261b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:55.171108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a46d8-34bf-48d8-ba15-f6a3c63261b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:55.172564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a46d8-34bf-48d8-ba15-f6a3c63261b2 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:55.197168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 719/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:57.308320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a6f8-fc60-485a-96ef-3f40b5aa1988 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.308907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a6f8-fc60-485a-96ef-3f40b5aa1988 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.308907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a6f8-fc60-485a-96ef-3f40b5aa1988 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.310251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:24:57.315946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919edb-55b6-4c1b-87d8-9b748dd77ea6 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.316470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919edb-55b6-4c1b-87d8-9b748dd77ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.316470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5919edb-55b6-4c1b-87d8-9b748dd77ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.389983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-d5919edb-55b6-4c1b-87d8-9b748dd77ea6 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:57.391207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d5919edb-55b6-4c1b-87d8-9b748dd77ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:57.405298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:57.532374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:57.817347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a6f8-fc60-485a-96ef-3f40b5aa1988 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:57.819535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6e63a6f8-fc60-485a-96ef-3f40b5aa1988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:57.938416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a6f8-fc60-485a-96ef-3f40b5aa1988 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:57.951982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:58.019557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becf4e3-1279-4723-adb0-9dfa9b01670f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.020175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becf4e3-1279-4723-adb0-9dfa9b01670f service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.020459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becf4e3-1279-4723-adb0-9dfa9b01670f service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.020730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becf4e3-1279-4723-adb0-9dfa9b01670f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.023016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7becf4e3-1279-4723-adb0-9dfa9b01670f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:58.135592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becf4e3-1279-4723-adb0-9dfa9b01670f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.137066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becf4e3-1279-4723-adb0-9dfa9b01670f service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.158298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 726/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:00.484182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27ab1-e7e8-4771-9bfc-39dcac5b447d None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:00.484765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27ab1-e7e8-4771-9bfc-39dcac5b447d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:00.484765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa27ab1-e7e8-4771-9bfc-39dcac5b447d None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:00.486149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:00.491565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5655-1d46-489c-8745-1d7d89b88257 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:00.492142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5655-1d46-489c-8745-1d7d89b88257 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:00.492142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b5655-1d46-489c-8745-1d7d89b88257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:00.541711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:00.560282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2d6b5655-1d46-489c-8745-1d7d89b88257 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:00.561531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2d6b5655-1d46-489c-8745-1d7d89b88257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:00.660328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:25:00.948650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27ab1-e7e8-4771-9bfc-39dcac5b447d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:00.950268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1fa27ab1-e7e8-4771-9bfc-39dcac5b447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:01.055965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa27ab1-e7e8-4771-9bfc-39dcac5b447d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.097548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:01.138420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a445a1f-59a9-4995-8031-a87fddc7b62a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.139144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445a1f-59a9-4995-8031-a87fddc7b62a service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.139547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445a1f-59a9-4995-8031-a87fddc7b62a service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.139814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a445a1f-59a9-4995-8031-a87fddc7b62a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.141577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8a445a1f-59a9-4995-8031-a87fddc7b62a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:01.261215 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a445a1f-59a9-4995-8031-a87fddc7b62a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.262689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a445a1f-59a9-4995-8031-a87fddc7b62a service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.281383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 722/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:25:03.325944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa445-e147-4549-bed9-c69afb17b790 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.326499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa445-e147-4549-bed9-c69afb17b790 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.326999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa445-e147-4549-bed9-c69afb17b790 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.329059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:03.336331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eece7-b5e3-4edb-aedb-81a177fe890b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.336843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eece7-b5e3-4edb-aedb-81a177fe890b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.336981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eece7-b5e3-4edb-aedb-81a177fe890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.414406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-125eece7-b5e3-4edb-aedb-81a177fe890b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:03.415623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-125eece7-b5e3-4edb-aedb-81a177fe890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:03.437208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:03.516345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:03.808756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa445-e147-4549-bed9-c69afb17b790 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.810364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f94aa445-e147-4549-bed9-c69afb17b790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:03.917162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa445-e147-4549-bed9-c69afb17b790 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:03.938023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:03.995223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0286f6-0b1a-4f9b-8556-e9899c1091e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:03.995893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0286f6-0b1a-4f9b-8556-e9899c1091e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.996173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0286f6-0b1a-4f9b-8556-e9899c1091e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.996447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0286f6-0b1a-4f9b-8556-e9899c1091e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.998085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7e0286f6-0b1a-4f9b-8556-e9899c1091e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:04.136544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0286f6-0b1a-4f9b-8556-e9899c1091e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:04.138062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0286f6-0b1a-4f9b-8556-e9899c1091e9 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:04.159609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 729/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:06.161580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660ee90-2176-4cfc-b215-85f16399b4b9 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:06.162186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660ee90-2176-4cfc-b215-85f16399b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:06.162186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660ee90-2176-4cfc-b215-85f16399b4b9 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:06.163485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:06.169522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88dea1-e47b-4cae-8cce-4f15e267a4b1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:06.169993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88dea1-e47b-4cae-8cce-4f15e267a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:06.170144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88dea1-e47b-4cae-8cce-4f15e267a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:06.239334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:06.242873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7a88dea1-e47b-4cae-8cce-4f15e267a4b1 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:06.244105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7a88dea1-e47b-4cae-8cce-4f15e267a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:06.345006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:25:06.631770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660ee90-2176-4cfc-b215-85f16399b4b9 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:06.633463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a660ee90-2176-4cfc-b215-85f16399b4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:06.739832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660ee90-2176-4cfc-b215-85f16399b4b9 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:06.789152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:06.813787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468f037-09e5-4d91-9830-377cb0b394c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:06.814391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f037-09e5-4d91-9830-377cb0b394c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:06.814670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f037-09e5-4d91-9830-377cb0b394c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:06.814944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468f037-09e5-4d91-9830-377cb0b394c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:06.816609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d468f037-09e5-4d91-9830-377cb0b394c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:06.939801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468f037-09e5-4d91-9830-377cb0b394c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:06.941411 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468f037-09e5-4d91-9830-377cb0b394c0 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:06.961359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 725/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:09.052481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db249-1ce9-42a8-8d46-e6379136201c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:09.053070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db249-1ce9-42a8-8d46-e6379136201c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:09.053070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73db249-1ce9-42a8-8d46-e6379136201c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:09.054424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:09.059888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52149-7c7b-453c-8864-b5719b19cfd7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:09.060318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52149-7c7b-453c-8864-b5719b19cfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:09.060446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52149-7c7b-453c-8864-b5719b19cfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:09.128350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-baa52149-7c7b-453c-8864-b5719b19cfd7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:09.129603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-baa52149-7c7b-453c-8864-b5719b19cfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:09.159171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:09.238800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:25:09.531598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73db249-1ce9-42a8-8d46-e6379136201c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:09.533275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e73db249-1ce9-42a8-8d46-e6379136201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:09.654314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73db249-1ce9-42a8-8d46-e6379136201c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:09.690893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:09.739557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c05e12-e7af-43ba-a6de-c7a4c64956fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:09.740170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c05e12-e7af-43ba-a6de-c7a4c64956fd service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:09.740453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c05e12-e7af-43ba-a6de-c7a4c64956fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:09.740737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c05e12-e7af-43ba-a6de-c7a4c64956fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:09.742486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-11c05e12-e7af-43ba-a6de-c7a4c64956fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:09.860767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c05e12-e7af-43ba-a6de-c7a4c64956fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:09.862398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c05e12-e7af-43ba-a6de-c7a4c64956fd service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:09.883942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 732/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:11.993156 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea8701-76f6-47a9-972c-2aacd1b4250b None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:11.993772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea8701-76f6-47a9-972c-2aacd1b4250b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:11.993772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea8701-76f6-47a9-972c-2aacd1b4250b None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:11.995065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:12.001180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069adb5c-8fe1-44d2-ac4c-4a7026b44993 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:12.001670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069adb5c-8fe1-44d2-ac4c-4a7026b44993 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:12.001781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069adb5c-8fe1-44d2-ac4c-4a7026b44993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:12.070384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-069adb5c-8fe1-44d2-ac4c-4a7026b44993 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:12.071611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-069adb5c-8fe1-44d2-ac4c-4a7026b44993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:12.080140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:12.175090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:12.466530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea8701-76f6-47a9-972c-2aacd1b4250b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:12.468428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1bea8701-76f6-47a9-972c-2aacd1b4250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:12.582920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea8701-76f6-47a9-972c-2aacd1b4250b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:12.644451 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:12.664805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3904af4-7556-4ea9-a92c-5d465f7369b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:12.665444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904af4-7556-4ea9-a92c-5d465f7369b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:12.665723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904af4-7556-4ea9-a92c-5d465f7369b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:12.665992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904af4-7556-4ea9-a92c-5d465f7369b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:12.667608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d3904af4-7556-4ea9-a92c-5d465f7369b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:12.793094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3904af4-7556-4ea9-a92c-5d465f7369b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:12.794491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3904af4-7556-4ea9-a92c-5d465f7369b2 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:12.814791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 728/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:14.862642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cc408-5871-4916-aec8-8e492ed28f21 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:14.863259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cc408-5871-4916-aec8-8e492ed28f21 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:14.863259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cc408-5871-4916-aec8-8e492ed28f21 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:14.864608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:14.870566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4e1de-96a1-4271-907d-0f12ddfd5c21 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:14.871091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4e1de-96a1-4271-907d-0f12ddfd5c21 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:14.871091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4e1de-96a1-4271-907d-0f12ddfd5c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:14.948815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8fd4e1de-96a1-4271-907d-0f12ddfd5c21 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:14.950732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8fd4e1de-96a1-4271-907d-0f12ddfd5c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:14.994168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:15.061965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:25:15.361666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cc408-5871-4916-aec8-8e492ed28f21 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:15.363215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-288cc408-5871-4916-aec8-8e492ed28f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:15.500907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cc408-5871-4916-aec8-8e492ed28f21 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:15.546022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:15.585869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7de4f2-c512-4d7a-91ad-d691349df465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:15.586749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de4f2-c512-4d7a-91ad-d691349df465 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:15.587219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de4f2-c512-4d7a-91ad-d691349df465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:15.587883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7de4f2-c512-4d7a-91ad-d691349df465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:15.589605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8e7de4f2-c512-4d7a-91ad-d691349df465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:15.719650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7de4f2-c512-4d7a-91ad-d691349df465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:15.721064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7de4f2-c512-4d7a-91ad-d691349df465 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:15.742356 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 735/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:17.760517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277455-9ebc-4aee-bf9f-ca14084a4a4b None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:17.761197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277455-9ebc-4aee-bf9f-ca14084a4a4b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:17.761197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277455-9ebc-4aee-bf9f-ca14084a4a4b None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:17.762480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:17.768654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eddec9-6fb8-4da8-a444-b72cff82bc0c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:17.769221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eddec9-6fb8-4da8-a444-b72cff82bc0c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:17.769221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eddec9-6fb8-4da8-a444-b72cff82bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:17.836277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-07eddec9-6fb8-4da8-a444-b72cff82bc0c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:17.837524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-07eddec9-6fb8-4da8-a444-b72cff82bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:17.855798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:17.943600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:25:18.238182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277455-9ebc-4aee-bf9f-ca14084a4a4b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:18.240479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-38277455-9ebc-4aee-bf9f-ca14084a4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:18.351158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277455-9ebc-4aee-bf9f-ca14084a4a4b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:18.424183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:18.430648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520eeec-d2e9-4643-ace5-6031e9f30c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:18.431256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520eeec-d2e9-4643-ace5-6031e9f30c80 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:18.431582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520eeec-d2e9-4643-ace5-6031e9f30c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:18.431853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520eeec-d2e9-4643-ace5-6031e9f30c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:18.433488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5520eeec-d2e9-4643-ace5-6031e9f30c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:18.550408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520eeec-d2e9-4643-ace5-6031e9f30c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:18.551918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520eeec-d2e9-4643-ace5-6031e9f30c80 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:18.571832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 731/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:20.588840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc7855-e9cb-4bcc-bb9d-ca72454bc656 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:20.589469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc7855-e9cb-4bcc-bb9d-ca72454bc656 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:20.589469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc7855-e9cb-4bcc-bb9d-ca72454bc656 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:20.590781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:20.596385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d307-4c3a-4d1c-80ea-91223091efaa None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:20.596876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d307-4c3a-4d1c-80ea-91223091efaa None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:20.597091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53d307-4c3a-4d1c-80ea-91223091efaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:20.669664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6d53d307-4c3a-4d1c-80ea-91223091efaa None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:20.670901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6d53d307-4c3a-4d1c-80ea-91223091efaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:20.719480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:20.768784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:21.051013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc7855-e9cb-4bcc-bb9d-ca72454bc656 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:21.052679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-41cc7855-e9cb-4bcc-bb9d-ca72454bc656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:21.167432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc7855-e9cb-4bcc-bb9d-ca72454bc656 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:21.218488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:21.245777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815e1f6-1b1a-4c5a-951e-4e8f9e8a7071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:21.246399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e1f6-1b1a-4c5a-951e-4e8f9e8a7071 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:21.246678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e1f6-1b1a-4c5a-951e-4e8f9e8a7071 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:21.246952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e1f6-1b1a-4c5a-951e-4e8f9e8a7071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:21.249343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1815e1f6-1b1a-4c5a-951e-4e8f9e8a7071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:21.365213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815e1f6-1b1a-4c5a-951e-4e8f9e8a7071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:21.366663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815e1f6-1b1a-4c5a-951e-4e8f9e8a7071 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:21.386969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 738/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:30.766835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=22 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:31.384640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=66 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:41.532978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d78e-483b-4641-a926-b3a9ced6206b None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:41.533563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d78e-483b-4641-a926-b3a9ced6206b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:41.533563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7d78e-483b-4641-a926-b3a9ced6206b None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:41.534932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 733/1471] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:41.541013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2f29e-0deb-440f-aea0-3bd5af20cf71 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:41.541552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2f29e-0deb-440f-aea0-3bd5af20cf71 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:41.541552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2f29e-0deb-440f-aea0-3bd5af20cf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:41.607457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a3c2f29e-0deb-440f-aea0-3bd5af20cf71 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:41.608688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a3c2f29e-0deb-440f-aea0-3bd5af20cf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:41.710614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 739/1472] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:42.016554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0314-147d-40fd-b3ad-5111d7a5272f None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:42.016844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0314-147d-40fd-b3ad-5111d7a5272f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:42.017159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0314-147d-40fd-b3ad-5111d7a5272f None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:42.018523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 734/1473] 10.222.0.39 () {54 vars in 961 bytes} [Mon Sep 5 12:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:42.024281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a63d-3b92-4a20-aa94-fc48b4756091 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:42.024708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a63d-3b92-4a20-aa94-fc48b4756091 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:42.025069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a63d-3b92-4a20-aa94-fc48b4756091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:42.125784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8183a63d-3b92-4a20-aa94-fc48b4756091 None None] MFA Rules not processed for user `66a29dd8d28f44f0b311d167fd39b4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:42.127032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8183a63d-3b92-4a20-aa94-fc48b4756091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:42.149670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:42.208721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 740/1474] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Sep 5 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:42.216220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0314-147d-40fd-b3ad-5111d7a5272f None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:42.217917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7e8a0314-147d-40fd-b3ad-5111d7a5272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:42.323543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0314-147d-40fd-b3ad-5111d7a5272f None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:42.400835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e128822-db6c-47f9-84d8-ddfeca71a390 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a29dd8d28f44f0b311d167fd39b4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:42.401489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128822-db6c-47f9-84d8-ddfeca71a390 service glance] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:42.401766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128822-db6c-47f9-84d8-ddfeca71a390 service glance] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:42.402048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e128822-db6c-47f9-84d8-ddfeca71a390 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:42.403655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0e128822-db6c-47f9-84d8-ddfeca71a390 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:42.456723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:42.519377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128822-db6c-47f9-84d8-ddfeca71a390 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:42.520807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e128822-db6c-47f9-84d8-ddfeca71a390 service glance] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:42.539435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 735/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:44.581889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340522-b474-492b-9429-1daed4b3600b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:44.582535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340522-b474-492b-9429-1daed4b3600b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:44.582535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340522-b474-492b-9429-1daed4b3600b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:44.583828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 741/1476] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:44.589333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402edc-9d0e-45c2-8775-b55b05cc3a35 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:44.589811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402edc-9d0e-45c2-8775-b55b05cc3a35 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:44.589924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402edc-9d0e-45c2-8775-b55b05cc3a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:44.657448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ad402edc-9d0e-45c2-8775-b55b05cc3a35 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:44.658671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ad402edc-9d0e-45c2-8775-b55b05cc3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:44.756978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 736/1477] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:45.026476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab340522-b474-492b-9429-1daed4b3600b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:45.027919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ab340522-b474-492b-9429-1daed4b3600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:45.156932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab340522-b474-492b-9429-1daed4b3600b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:45.209622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:45.253959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47663aa3-8a58-47ce-a456-24ff011dfc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:45.255077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47663aa3-8a58-47ce-a456-24ff011dfc75 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:45.255357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47663aa3-8a58-47ce-a456-24ff011dfc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:45.255628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47663aa3-8a58-47ce-a456-24ff011dfc75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:45.256268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47663aa3-8a58-47ce-a456-24ff011dfc75 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:45.258047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-47663aa3-8a58-47ce-a456-24ff011dfc75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:25:45.258047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: warnings.warn(msg) Sep 05 12:25:45.258047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: Sep 05 12:25:45.259192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47663aa3-8a58-47ce-a456-24ff011dfc75 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:45.278992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 742/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Sep 5 12:25:45 2022] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:25:47.227134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94cda-7343-480e-98b1-0ce080494504 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:47.227713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94cda-7343-480e-98b1-0ce080494504 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:47.227713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94cda-7343-480e-98b1-0ce080494504 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:47.229034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 737/1479] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:47.234476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3720c0-c50b-49cb-b650-9ab5d7949280 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:47.234944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3720c0-c50b-49cb-b650-9ab5d7949280 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:47.235105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3720c0-c50b-49cb-b650-9ab5d7949280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:47.303410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-bb3720c0-c50b-49cb-b650-9ab5d7949280 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:47.305357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bb3720c0-c50b-49cb-b650-9ab5d7949280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:47.408212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 743/1480] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:47.705141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94cda-7343-480e-98b1-0ce080494504 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:47.706680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2eb94cda-7343-480e-98b1-0ce080494504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:47.716865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:47.856580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94cda-7343-480e-98b1-0ce080494504 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:47.940548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:47.974573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aa3e3-eca0-4798-b2c6-dd1d09b5d6f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:47.975188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa3e3-eca0-4798-b2c6-dd1d09b5d6f5 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:47.975471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa3e3-eca0-4798-b2c6-dd1d09b5d6f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:47.975746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aa3e3-eca0-4798-b2c6-dd1d09b5d6f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:47.977407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-316aa3e3-eca0-4798-b2c6-dd1d09b5d6f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:48.070536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aa3e3-eca0-4798-b2c6-dd1d09b5d6f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:48.072168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aa3e3-eca0-4798-b2c6-dd1d09b5d6f5 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:48.091104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 738/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:50.234106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff9846-ce95-4536-b442-2eccd56d2ce9 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:50.234754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff9846-ce95-4536-b442-2eccd56d2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:50.234754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff9846-ce95-4536-b442-2eccd56d2ce9 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:50.235998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 744/1482] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:50.242107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5005d-3c98-4e68-a90e-f59416dda177 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:50.246766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5005d-3c98-4e68-a90e-f59416dda177 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:50.246766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5005d-3c98-4e68-a90e-f59416dda177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:50.311574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-97b5005d-3c98-4e68-a90e-f59416dda177 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:50.312790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-97b5005d-3c98-4e68-a90e-f59416dda177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:50.360180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:50.415313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 739/1483] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:50.701530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff9846-ce95-4536-b442-2eccd56d2ce9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:50.703051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-52ff9846-ce95-4536-b442-2eccd56d2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:50.726685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:50.807146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff9846-ce95-4536-b442-2eccd56d2ce9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:50.887181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de697a97-c685-4f35-8e16-26aaedd73698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:50.887181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de697a97-c685-4f35-8e16-26aaedd73698 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:50.887181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de697a97-c685-4f35-8e16-26aaedd73698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:50.887690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de697a97-c685-4f35-8e16-26aaedd73698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:50.888873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-de697a97-c685-4f35-8e16-26aaedd73698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:50.965652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:50.999789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de697a97-c685-4f35-8e16-26aaedd73698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:51.001591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de697a97-c685-4f35-8e16-26aaedd73698 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:51.021414 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 745/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:53.014582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df77d-7f88-4819-abf3-94222cbeb583 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:53.015196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df77d-7f88-4819-abf3-94222cbeb583 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:53.015196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df77d-7f88-4819-abf3-94222cbeb583 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:53.016525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 740/1485] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:53.022443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b625a-5d8b-4847-ab85-a142bd7c90ea None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:53.022873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b625a-5d8b-4847-ab85-a142bd7c90ea None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:53.022994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b625a-5d8b-4847-ab85-a142bd7c90ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:53.090713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-271b625a-5d8b-4847-ab85-a142bd7c90ea None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:53.091859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-271b625a-5d8b-4847-ab85-a142bd7c90ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:53.188504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 746/1486] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:53.477465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df77d-7f88-4819-abf3-94222cbeb583 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:53.479045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-868df77d-7f88-4819-abf3-94222cbeb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:53.582776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df77d-7f88-4819-abf3-94222cbeb583 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:53.655728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:53.657701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fe963-31ef-4f9c-80bd-a1f51f253068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:53.658311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe963-31ef-4f9c-80bd-a1f51f253068 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:53.658592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe963-31ef-4f9c-80bd-a1f51f253068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:53.658862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fe963-31ef-4f9c-80bd-a1f51f253068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:53.660990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9e3fe963-31ef-4f9c-80bd-a1f51f253068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:53.768606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fe963-31ef-4f9c-80bd-a1f51f253068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:53.770061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fe963-31ef-4f9c-80bd-a1f51f253068 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:53.788124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 741/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:55.884712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed77e1-29ce-473b-be20-45e1fb2621e0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:55.885296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed77e1-29ce-473b-be20-45e1fb2621e0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:55.885296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed77e1-29ce-473b-be20-45e1fb2621e0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:55.886651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 747/1488] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:55.892015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d116c6-053a-4f1d-8f5d-d2ad988ec8ce None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:55.892458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d116c6-053a-4f1d-8f5d-d2ad988ec8ce None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:55.892575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d116c6-053a-4f1d-8f5d-d2ad988ec8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:55.960258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a2d116c6-053a-4f1d-8f5d-d2ad988ec8ce None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:55.961506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a2d116c6-053a-4f1d-8f5d-d2ad988ec8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:56.012606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:56.056513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 742/1489] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:56.346197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed77e1-29ce-473b-be20-45e1fb2621e0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:56.347753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-75ed77e1-29ce-473b-be20-45e1fb2621e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:56.384169 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:56.454659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed77e1-29ce-473b-be20-45e1fb2621e0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:56.527842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf222fb-c1db-466b-935d-e6dbdd63e48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:56.528442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf222fb-c1db-466b-935d-e6dbdd63e48c service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:56.528723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf222fb-c1db-466b-935d-e6dbdd63e48c service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:56.529012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf222fb-c1db-466b-935d-e6dbdd63e48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:56.530596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2cf222fb-c1db-466b-935d-e6dbdd63e48c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:56.613127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:56.647147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf222fb-c1db-466b-935d-e6dbdd63e48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:56.648563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf222fb-c1db-466b-935d-e6dbdd63e48c service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:56.668462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 748/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:58.989998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7e18a-7bde-4727-bb96-e3130516d0eb None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:58.990548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7e18a-7bde-4727-bb96-e3130516d0eb None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:58.990548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7e18a-7bde-4727-bb96-e3130516d0eb None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:58.991945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 743/1491] 10.222.0.39 () {54 vars in 927 bytes} [Mon Sep 5 12:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:25:58.997315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f1a5-d5f6-4a50-8ef3-bf7e81b2b385 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:58.997770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f1a5-d5f6-4a50-8ef3-bf7e81b2b385 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:58.997883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f1a5-d5f6-4a50-8ef3-bf7e81b2b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:59.066274 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1f71f1a5-d5f6-4a50-8ef3-bf7e81b2b385 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:59.067715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1f71f1a5-d5f6-4a50-8ef3-bf7e81b2b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:59.168973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 749/1492] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Sep 5 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:59.468315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7e18a-7bde-4727-bb96-e3130516d0eb None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:59.469886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ddb7e18a-7bde-4727-bb96-e3130516d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:59.577135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7e18a-7bde-4727-bb96-e3130516d0eb None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:59.654266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eb91f-7d15-40bd-9eb6-e4a429e8be95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:59.654887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb91f-7d15-40bd-9eb6-e4a429e8be95 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:59.655172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb91f-7d15-40bd-9eb6-e4a429e8be95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:59.655444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb91f-7d15-40bd-9eb6-e4a429e8be95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:59.657176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9e5eb91f-7d15-40bd-9eb6-e4a429e8be95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:59.667207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:59.766844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5eb91f-7d15-40bd-9eb6-e4a429e8be95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:59.768248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5eb91f-7d15-40bd-9eb6-e4a429e8be95 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:59.787127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 744/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:09.167118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=82 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:09.818185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=50 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:23.146373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d4993-bcde-47dd-b831-afe616a87336 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:23.147033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d4993-bcde-47dd-b831-afe616a87336 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:23.147033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d4993-bcde-47dd-b831-afe616a87336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:23.230994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6e7d4993-bcde-47dd-b831-afe616a87336 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:23.232242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6e7d4993-bcde-47dd-b831-afe616a87336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:23.348895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 750/1494] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:23.357482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d54802-7f33-4284-addd-0417d67a5082 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:23.358141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d54802-7f33-4284-addd-0417d67a5082 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:23.358141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d54802-7f33-4284-addd-0417d67a5082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:23.448057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-40d54802-7f33-4284-addd-0417d67a5082 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:23.449235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-40d54802-7f33-4284-addd-0417d67a5082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:23.555679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 745/1495] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:23.560480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d4993-bcde-47dd-b831-afe616a87336 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:23.561756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6e7d4993-bcde-47dd-b831-afe616a87336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:23.573674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d4993-bcde-47dd-b831-afe616a87336 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:23.641326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:23.681285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:23.681902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:23.682187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:23.682524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:23.683193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:27:23.683740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:23.685113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:27:23.685113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: warnings.warn(msg) Sep 05 12:27:23.685113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: Sep 05 12:27:23.686368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:23.700185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 751/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:27:23.715266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d54802-7f33-4284-addd-0417d67a5082 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:23.732538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d54802-7f33-4284-addd-0417d67a5082 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:23.843165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:23.893148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:23.894405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:23.894685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:23.894955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:23.895597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:23.897501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING py.warnings [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:27:23.897501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: warnings.warn(msg) Sep 05 12:27:23.897501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: Sep 05 12:27:23.898736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:24.039115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 746/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:27:23 2022] POST /identity/v3/projects => generated 379 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:27:24.045446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:24.048386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:24.091618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ebe1-e862-4c0c-a22c-efc6a02399a1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:24.208021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:24.209148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:24.209654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:24.210137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:24.211284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:24.213229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:27:24.213229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: warnings.warn(msg) Sep 05 12:27:24.213229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: Sep 05 12:27:24.215720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:24.359013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 752/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:27:24 2022] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:27:24.364682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:24.366219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:24.442387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab711b-65b3-4705-a501-de72b4f0eaef admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:24.554429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:24.565974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:24.566600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:24.566888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:24.567157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:24.567887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:24.568941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING py.warnings [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:27:24.568941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: warnings.warn(msg) Sep 05 12:27:24.568941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: Sep 05 12:27:24.569882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:24.584781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 747/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:27:24.589159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:24.590750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:24.603438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaa6a-92d9-436a-8f9d-51e42f38c435 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:24.632299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:24.713637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbabd73-26fd-49d7-b064-8a40c4443b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:24.714504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbabd73-26fd-49d7-b064-8a40c4443b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:24.714795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbabd73-26fd-49d7-b064-8a40c4443b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:24.715065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbabd73-26fd-49d7-b064-8a40c4443b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:24.715807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbabd73-26fd-49d7-b064-8a40c4443b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:24.716910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-8dbabd73-26fd-49d7-b064-8a40c4443b4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:27:24.716910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: warnings.warn(msg) Sep 05 12:27:24.716910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: Sep 05 12:27:24.717870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbabd73-26fd-49d7-b064-8a40c4443b4d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:24.732988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 753/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:27:24.737317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:24.738910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:24.776402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbaae2-33c7-4e34-b957-59133328a310 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:24.891417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5070a-d940-447e-b3ce-0db59bdca588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:24.892039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5070a-d940-447e-b3ce-0db59bdca588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:24.892316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5070a-d940-447e-b3ce-0db59bdca588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:24.892596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5070a-d940-447e-b3ce-0db59bdca588 admin admin] PATH_INFO: `/v3/projects/982ca3f6cfad41bf868bc32e8a24b0bf/users/cd18c0646f6946fa977a11aa4c2ffe17/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:24.919414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5070a-d940-447e-b3ce-0db59bdca588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=982ca3f6cfad41bf868bc32e8a24b0bf, user_id=cd18c0646f6946fa977a11aa4c2ffe17, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:24.920475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING py.warnings [None req-69c5070a-d940-447e-b3ce-0db59bdca588 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:27:24.920475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: warnings.warn(msg) Sep 05 12:27:24.920475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: Sep 05 12:27:24.922502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5070a-d940-447e-b3ce-0db59bdca588 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:25.026634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 748/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:27:24 2022] PUT /identity/v3/projects/982ca3f6cfad41bf868bc32e8a24b0bf/users/cd18c0646f6946fa977a11aa4c2ffe17/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:27:25.039984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5b41-2c6e-4ae5-b05a-883c55581619 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:25.040279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5b41-2c6e-4ae5-b05a-883c55581619 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:25.040564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5b41-2c6e-4ae5-b05a-883c55581619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:25.102154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fd1d5b41-2c6e-4ae5-b05a-883c55581619 None None] MFA Rules not processed for user `cd18c0646f6946fa977a11aa4c2ffe17`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:25.103391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fd1d5b41-2c6e-4ae5-b05a-883c55581619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:25.190997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 754/1502] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:25.211378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7ed4-54ad-4a66-ae9e-6e50c228a388 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:25.211873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7ed4-54ad-4a66-ae9e-6e50c228a388 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:25.212367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7ed4-54ad-4a66-ae9e-6e50c228a388 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:25.214801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 749/1503] 10.222.0.39 () {54 vars in 964 bytes} [Mon Sep 5 12:27:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:27:25.220831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1217157-4e6d-492d-be1f-9616b10f8217 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:25.222192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1217157-4e6d-492d-be1f-9616b10f8217 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:25.222192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1217157-4e6d-492d-be1f-9616b10f8217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:25.259559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:25.319928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d1217157-4e6d-492d-be1f-9616b10f8217 None None] MFA Rules not processed for user `77ae8a6fe7ff4190aa3cd8c7f820d15b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:25.321268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d1217157-4e6d-492d-be1f-9616b10f8217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:25.416185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 755/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Sep 5 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:25.425948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7ed4-54ad-4a66-ae9e-6e50c228a388 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:25.428802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-375a7ed4-54ad-4a66-ae9e-6e50c228a388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:25.530761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:25.595944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7ed4-54ad-4a66-ae9e-6e50c228a388 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:25.685569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:25.686188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:25.686469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:25.686741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:25.688464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:25.966624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:25.968124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:25.972656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:25.991064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 750/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:27:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:27:26.058483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840e611-2f18-4b89-88e7-35511147bd77 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:26.058917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840e611-2f18-4b89-88e7-35511147bd77 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:26.059284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840e611-2f18-4b89-88e7-35511147bd77 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:26.060698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 756/1506] 10.222.0.39 () {52 vars in 830 bytes} [Mon Sep 5 12:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:27:26.065414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:26.067432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:26.195087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaad00-8333-479d-b192-d394739b5469 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:26.301387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:26.302028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:26.302318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:26.302591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] PATH_INFO: `/v3/users/cd18c0646f6946fa977a11aa4c2ffe17` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:26.316842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd18c0646f6946fa977a11aa4c2ffe17)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:26.317933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING py.warnings [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:27:26.317933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: warnings.warn(msg) Sep 05 12:27:26.317933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: Sep 05 12:27:26.319182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:26.329957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:26.543154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd18c0646f6946fa977a11aa4c2ffe17'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:26.543917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd18c0646f6946fa977a11aa4c2ffe17'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:26.623524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd18c0646f6946fa977a11aa4c2ffe17'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:26.656255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd18c0646f6946fa977a11aa4c2ffe17'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:26.656981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd18c0646f6946fa977a11aa4c2ffe17'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:26.680495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 751/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:27:26 2022] DELETE /identity/v3/users/cd18c0646f6946fa977a11aa4c2ffe17 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:27:26.687566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819db8a-d541-451f-a536-fc137a349eee None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:26.688168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819db8a-d541-451f-a536-fc137a349eee None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:26.688604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819db8a-d541-451f-a536-fc137a349eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:26.763782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7819db8a-d541-451f-a536-fc137a349eee None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:26.765048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7819db8a-d541-451f-a536-fc137a349eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:26.843061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:26.856168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 757/1508] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:26.866046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:26.867520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:26.991908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb73c8-2f05-4fae-bcb8-b57be5686b95 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:27.052538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:27.072929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6ce4a-ee45-423b-9ad0-bf61793e799e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:27.073587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ce4a-ee45-423b-9ad0-bf61793e799e service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:27.073871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ce4a-ee45-423b-9ad0-bf61793e799e service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:27.074145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6ce4a-ee45-423b-9ad0-bf61793e799e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:27.075815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5db6ce4a-ee45-423b-9ad0-bf61793e799e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:27.199700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6ce4a-ee45-423b-9ad0-bf61793e799e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:27.202134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6ce4a-ee45-423b-9ad0-bf61793e799e service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:27.232226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 752/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:27:27.786739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819db8a-d541-451f-a536-fc137a349eee None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:27.792406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7819db8a-d541-451f-a536-fc137a349eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:27.811445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819db8a-d541-451f-a536-fc137a349eee None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:27.965736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:27.966385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:27.966660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:27.966929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] PATH_INFO: `/v3/projects/982ca3f6cfad41bf868bc32e8a24b0bf` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:27.978342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=982ca3f6cfad41bf868bc32e8a24b0bf)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:27.979415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:27:27.979415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: warnings.warn(msg) Sep 05 12:27:27.979415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: Sep 05 12:27:27.980720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:28.157488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '982ca3f6cfad41bf868bc32e8a24b0bf', 'request_id': 'req-857d10b8-970d-4c49-8308-54bbb3a41880'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:28.172894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '982ca3f6cfad41bf868bc32e8a24b0bf', 'request_id': 'req-857d10b8-970d-4c49-8308-54bbb3a41880'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:28.180111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '982ca3f6cfad41bf868bc32e8a24b0bf', 'request_id': 'req-857d10b8-970d-4c49-8308-54bbb3a41880'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:28.297240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] The token cache is being invalidate because project 982ca3f6cfad41bf868bc32e8a24b0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:27:28.297535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:28.297979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-857d10b8-970d-4c49-8308-54bbb3a41880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:28.299427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 758/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:27:27 2022] DELETE /identity/v3/projects/982ca3f6cfad41bf868bc32e8a24b0bf => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:27:37.228939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=62 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:38.295150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:06.376168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf252f8-2513-4e5f-81c5-029bd31bb5e6 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:06.376818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf252f8-2513-4e5f-81c5-029bd31bb5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:06.376818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf252f8-2513-4e5f-81c5-029bd31bb5e6 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:06.378846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:29:06.385745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728461c9-2f4b-4e9d-9a07-ee5591bc928a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:06.388698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728461c9-2f4b-4e9d-9a07-ee5591bc928a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:06.388698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728461c9-2f4b-4e9d-9a07-ee5591bc928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:06.477376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-728461c9-2f4b-4e9d-9a07-ee5591bc928a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:06.478546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-728461c9-2f4b-4e9d-9a07-ee5591bc928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:06.598629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:06.754477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf252f8-2513-4e5f-81c5-029bd31bb5e6 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:06.756676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6bf252f8-2513-4e5f-81c5-029bd31bb5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:06.879250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf252f8-2513-4e5f-81c5-029bd31bb5e6 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:06.884491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c788c-9178-498a-9600-0ae5da460834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:06.885152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c788c-9178-498a-9600-0ae5da460834 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:06.885434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c788c-9178-498a-9600-0ae5da460834 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:06.885741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c788c-9178-498a-9600-0ae5da460834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:06.894484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c788c-9178-498a-9600-0ae5da460834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:06.896086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c788c-9178-498a-9600-0ae5da460834 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:06.905748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 754/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:07.758695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4fed-a6ec-4efd-920b-246c1ad7366d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:07.759155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4fed-a6ec-4efd-920b-246c1ad7366d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:07.759254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf4fed-a6ec-4efd-920b-246c1ad7366d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:07.760594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:29:07.765654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65986e-66fa-4d3d-a3e7-4f6b5ea9bdd7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:07.766145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65986e-66fa-4d3d-a3e7-4f6b5ea9bdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:07.766246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65986e-66fa-4d3d-a3e7-4f6b5ea9bdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:07.787623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8d65986e-66fa-4d3d-a3e7-4f6b5ea9bdd7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:07.788888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8d65986e-66fa-4d3d-a3e7-4f6b5ea9bdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:07.797483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:07.950888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf4fed-a6ec-4efd-920b-246c1ad7366d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:07.968421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf4fed-a6ec-4efd-920b-246c1ad7366d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:07.974194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105f387-ce04-4dd4-94dc-297c25b5a09e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:07.974798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105f387-ce04-4dd4-94dc-297c25b5a09e service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:07.975080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105f387-ce04-4dd4-94dc-297c25b5a09e service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:07.975351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105f387-ce04-4dd4-94dc-297c25b5a09e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:07.983810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105f387-ce04-4dd4-94dc-297c25b5a09e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:07.985423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105f387-ce04-4dd4-94dc-297c25b5a09e service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:07.994824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 761/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:09.514857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c3255-bf6d-442c-92dc-3293bcea0ef0 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:09.515445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c3255-bf6d-442c-92dc-3293bcea0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:09.515445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c3255-bf6d-442c-92dc-3293bcea0ef0 None None] PATH_INFO: `/v3` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:09.516699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 756/1517] 10.222.0.70 () {54 vars in 925 bytes} [Mon Sep 5 12:29:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:29:09.523530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814dc7-dde3-481f-ad81-64d2bbc0a232 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:09.524007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814dc7-dde3-481f-ad81-64d2bbc0a232 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:09.524117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36814dc7-dde3-481f-ad81-64d2bbc0a232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:09.584340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-36814dc7-dde3-481f-ad81-64d2bbc0a232 None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:09.585609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-36814dc7-dde3-481f-ad81-64d2bbc0a232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:09.602310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:09.662213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 762/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Sep 5 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:14.227297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af22ab-0c8c-4e2a-8958-ddd00392f56b None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:14.227724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af22ab-0c8c-4e2a-8958-ddd00392f56b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:14.227881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af22ab-0c8c-4e2a-8958-ddd00392f56b None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:14.229258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 757/1519] 10.222.0.39 () {54 vars in 961 bytes} [Mon Sep 5 12:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:29:14.234283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfea8-b1c7-431a-a200-43fafbb923ae None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:14.234705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfea8-b1c7-431a-a200-43fafbb923ae None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:14.234849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfea8-b1c7-431a-a200-43fafbb923ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:14.254813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-40ebfea8-b1c7-431a-a200-43fafbb923ae None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:14.256719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-40ebfea8-b1c7-431a-a200-43fafbb923ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:14.266019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 763/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Sep 5 12:29:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:14.275820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af22ab-0c8c-4e2a-8958-ddd00392f56b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:14.290308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af22ab-0c8c-4e2a-8958-ddd00392f56b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:14.295409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224dce5-2e1d-4394-a658-870b41b8ed24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:14.296386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224dce5-2e1d-4394-a658-870b41b8ed24 service placement] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:14.296589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224dce5-2e1d-4394-a658-870b41b8ed24 service placement] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:14.297425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224dce5-2e1d-4394-a658-870b41b8ed24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:14.305766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224dce5-2e1d-4394-a658-870b41b8ed24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:14.307353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224dce5-2e1d-4394-a658-870b41b8ed24 service placement] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:14.317326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 758/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:19.256267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c374-b90e-4a58-b2d9-f6ba8ddf75b0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:19.256865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c374-b90e-4a58-b2d9-f6ba8ddf75b0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:19.256865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4c374-b90e-4a58-b2d9-f6ba8ddf75b0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:19.258224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:29:19.263121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca9db-ab0a-4f7c-af67-fbb8773cb207 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:19.263606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca9db-ab0a-4f7c-af67-fbb8773cb207 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:19.263725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca9db-ab0a-4f7c-af67-fbb8773cb207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:19.283895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0c9ca9db-ab0a-4f7c-af67-fbb8773cb207 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:19.285146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0c9ca9db-ab0a-4f7c-af67-fbb8773cb207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:19.293776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:19.457094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c374-b90e-4a58-b2d9-f6ba8ddf75b0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:19.472333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4c374-b90e-4a58-b2d9-f6ba8ddf75b0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:19.478373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4301-4245-4fa0-ad82-67d32a419615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:19.478966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4301-4245-4fa0-ad82-67d32a419615 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:19.479249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4301-4245-4fa0-ad82-67d32a419615 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:19.479534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4301-4245-4fa0-ad82-67d32a419615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:19.487869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a4301-4245-4fa0-ad82-67d32a419615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:19.492438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a4301-4245-4fa0-ad82-67d32a419615 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:19.499526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 765/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:20.334715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b076-1ff5-4d25-ac30-cef50df294d5 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:20.335361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b076-1ff5-4d25-ac30-cef50df294d5 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:20.335361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77b076-1ff5-4d25-ac30-cef50df294d5 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:20.336754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:29:20.341790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9eae-83c2-4c86-a184-699fcc46e053 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:20.342236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9eae-83c2-4c86-a184-699fcc46e053 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:20.342343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b9eae-83c2-4c86-a184-699fcc46e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:20.362406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a15b9eae-83c2-4c86-a184-699fcc46e053 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:20.363618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a15b9eae-83c2-4c86-a184-699fcc46e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:20.371559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:20.538777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77b076-1ff5-4d25-ac30-cef50df294d5 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:20.557129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77b076-1ff5-4d25-ac30-cef50df294d5 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:20.562497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e3a2d-bd7a-461b-bedc-48f26306c9c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:20.563090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3a2d-bd7a-461b-bedc-48f26306c9c1 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:20.563370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3a2d-bd7a-461b-bedc-48f26306c9c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:20.563643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e3a2d-bd7a-461b-bedc-48f26306c9c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:20.572149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e3a2d-bd7a-461b-bedc-48f26306c9c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:20.573784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e3a2d-bd7a-461b-bedc-48f26306c9c1 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:20.583669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 761/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:24.654509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afd27-599c-4612-b87e-78376121d244 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:24.655079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afd27-599c-4612-b87e-78376121d244 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:24.655079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619afd27-599c-4612-b87e-78376121d244 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:24.656415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:29:24.662390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65e19-8947-47ab-8bb5-523e717beb7f None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:24.662841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65e19-8947-47ab-8bb5-523e717beb7f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:24.662949 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65e19-8947-47ab-8bb5-523e717beb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:24.682128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-91e65e19-8947-47ab-8bb5-523e717beb7f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:24.683374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-91e65e19-8947-47ab-8bb5-523e717beb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:24.691314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:24.981079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619afd27-599c-4612-b87e-78376121d244 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:24.982852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-619afd27-599c-4612-b87e-78376121d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:25.064543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619afd27-599c-4612-b87e-78376121d244 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:25.070336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f033c-2aeb-4191-a061-ef66dd6b4780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:25.071392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f033c-2aeb-4191-a061-ef66dd6b4780 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:25.071906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f033c-2aeb-4191-a061-ef66dd6b4780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:25.072466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f033c-2aeb-4191-a061-ef66dd6b4780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:25.084634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f033c-2aeb-4191-a061-ef66dd6b4780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:25.086120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f033c-2aeb-4191-a061-ef66dd6b4780 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:25.101346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 768/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:26.999256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c3e1-dd2e-4c43-8370-b476614b3f5c None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:26.999822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c3e1-dd2e-4c43-8370-b476614b3f5c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:26.999822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08c3e1-dd2e-4c43-8370-b476614b3f5c None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:27.001193 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:29:27.006935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489953be-54d8-49eb-88d3-c54d2a9e891d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:27.007389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489953be-54d8-49eb-88d3-c54d2a9e891d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:27.007486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489953be-54d8-49eb-88d3-c54d2a9e891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:27.027777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-489953be-54d8-49eb-88d3-c54d2a9e891d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:27.029002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-489953be-54d8-49eb-88d3-c54d2a9e891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:27.036898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:27.325865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08c3e1-dd2e-4c43-8370-b476614b3f5c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:27.327583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8b08c3e1-dd2e-4c43-8370-b476614b3f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:27.335140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=75 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:27.340547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08c3e1-dd2e-4c43-8370-b476614b3f5c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:27.344179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c386af-f011-4fa5-a70c-4127aac4b4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:27.344780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c386af-f011-4fa5-a70c-4127aac4b4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:27.349631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c386af-f011-4fa5-a70c-4127aac4b4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:27.349631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c386af-f011-4fa5-a70c-4127aac4b4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:27.354918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c386af-f011-4fa5-a70c-4127aac4b4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:27.356461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c386af-f011-4fa5-a70c-4127aac4b4d8 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:27.366626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 764/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:30.924688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fce18-c933-4f2e-8b4a-01c4e19355d8 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:30.925265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fce18-c933-4f2e-8b4a-01c4e19355d8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:30.925265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fce18-c933-4f2e-8b4a-01c4e19355d8 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:30.926620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:29:30.931995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da45cb-d32e-494d-ade5-9a6db70c10fc None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:30.932514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da45cb-d32e-494d-ade5-9a6db70c10fc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:30.932514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da45cb-d32e-494d-ade5-9a6db70c10fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:30.954517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-04da45cb-d32e-494d-ade5-9a6db70c10fc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:30.955731 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-04da45cb-d32e-494d-ade5-9a6db70c10fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:30.964470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:31.534008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fce18-c933-4f2e-8b4a-01c4e19355d8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:31.535702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4a6fce18-c933-4f2e-8b4a-01c4e19355d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:31.602009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:31.615054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fce18-c933-4f2e-8b4a-01c4e19355d8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:31.618624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb5884-7f5c-4b64-9bc3-e0ae4f067930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:31.619228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb5884-7f5c-4b64-9bc3-e0ae4f067930 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:31.619509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb5884-7f5c-4b64-9bc3-e0ae4f067930 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:31.619781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb5884-7f5c-4b64-9bc3-e0ae4f067930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:31.628837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb5884-7f5c-4b64-9bc3-e0ae4f067930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:31.630813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb5884-7f5c-4b64-9bc3-e0ae4f067930 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:31.640403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 771/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:33.604183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522db39-1e0b-4fe9-83bd-071aa09b440e None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:33.604741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522db39-1e0b-4fe9-83bd-071aa09b440e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:33.604841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522db39-1e0b-4fe9-83bd-071aa09b440e None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:33.606231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:29:33.611686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273df8cc-8b89-4801-bb58-86238a7c11a0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:33.612099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273df8cc-8b89-4801-bb58-86238a7c11a0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:33.612241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273df8cc-8b89-4801-bb58-86238a7c11a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:33.632726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-273df8cc-8b89-4801-bb58-86238a7c11a0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:29:33.633974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-273df8cc-8b89-4801-bb58-86238a7c11a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:33.641781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:29:34.226137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522db39-1e0b-4fe9-83bd-071aa09b440e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:29:34.227834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a522db39-1e0b-4fe9-83bd-071aa09b440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:29:34.241275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522db39-1e0b-4fe9-83bd-071aa09b440e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:29:34.244520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f96ebd-968c-4830-bef4-41812763bdd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:29:34.245149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f96ebd-968c-4830-bef4-41812763bdd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:29:34.249092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f96ebd-968c-4830-bef4-41812763bdd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:29:34.249092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f96ebd-968c-4830-bef4-41812763bdd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:29:34.254669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f96ebd-968c-4830-bef4-41812763bdd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:29:34.256196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f96ebd-968c-4830-bef4-41812763bdd9 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:29:34.265659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 767/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:29:43.627316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=11 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:29:44.261368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=14 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:06.499526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe31fc-1ac7-4c13-92cb-a166b771e51c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:06.500757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe31fc-1ac7-4c13-92cb-a166b771e51c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:06.501295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe31fc-1ac7-4c13-92cb-a166b771e51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:06.528667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7fbe31fc-1ac7-4c13-92cb-a166b771e51c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:06.529853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7fbe31fc-1ac7-4c13-92cb-a166b771e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:06.542425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 773/1540] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:06.552511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e535c-f01b-4401-afba-cdfad89d186a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:06.553664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e535c-f01b-4401-afba-cdfad89d186a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:06.554173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e535c-f01b-4401-afba-cdfad89d186a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:06.581343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-fa0e535c-f01b-4401-afba-cdfad89d186a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:06.583068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-fa0e535c-f01b-4401-afba-cdfad89d186a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:06.598373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 768/1541] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:06.603790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe31fc-1ac7-4c13-92cb-a166b771e51c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:06.619650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe31fc-1ac7-4c13-92cb-a166b771e51c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:06.628841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18861b9-9779-4634-b700-d523bf444246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:06.629768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18861b9-9779-4634-b700-d523bf444246 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:06.630054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18861b9-9779-4634-b700-d523bf444246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:06.630329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18861b9-9779-4634-b700-d523bf444246 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:06.631036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18861b9-9779-4634-b700-d523bf444246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:06.631345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18861b9-9779-4634-b700-d523bf444246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:06.632994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18861b9-9779-4634-b700-d523bf444246 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:06.651871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 774/1542] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:06.660634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e535c-f01b-4401-afba-cdfad89d186a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:06.676663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e535c-f01b-4401-afba-cdfad89d186a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:06.682395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12170738-cc6f-4204-af90-685cb3551ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:06.683393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170738-cc6f-4204-af90-685cb3551ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:06.683905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170738-cc6f-4204-af90-685cb3551ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:06.684425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170738-cc6f-4204-af90-685cb3551ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:06.685359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12170738-cc6f-4204-af90-685cb3551ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:06.687528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12170738-cc6f-4204-af90-685cb3551ef8 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:06.748210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d994-573f-4827-b83f-28ac66cf06a5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:06.748645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d994-573f-4827-b83f-28ac66cf06a5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:06.748936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34d994-573f-4827-b83f-28ac66cf06a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:06.783346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9b34d994-573f-4827-b83f-28ac66cf06a5 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:06.784598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9b34d994-573f-4827-b83f-28ac66cf06a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:06.802240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 775/1543] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 05 12:31:06.804255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 769/1544] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:06 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:06.808677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d994-573f-4827-b83f-28ac66cf06a5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:06.813134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841e723-2e75-4713-bc97-c8c664f70b68 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:06.813134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841e723-2e75-4713-bc97-c8c664f70b68 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:06.813134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841e723-2e75-4713-bc97-c8c664f70b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:06.830278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34d994-573f-4827-b83f-28ac66cf06a5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:06.855397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a841e723-2e75-4713-bc97-c8c664f70b68 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:06.860981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a841e723-2e75-4713-bc97-c8c664f70b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:06.975993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 770/1545] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:06.981368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841e723-2e75-4713-bc97-c8c664f70b68 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:06.992047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841e723-2e75-4713-bc97-c8c664f70b68 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:06.999118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8da1d-5784-4877-89a9-6f6dcc4414f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:06.999767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8da1d-5784-4877-89a9-6f6dcc4414f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.000049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8da1d-5784-4877-89a9-6f6dcc4414f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.000324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8da1d-5784-4877-89a9-6f6dcc4414f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.001025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8da1d-5784-4877-89a9-6f6dcc4414f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.003078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8da1d-5784-4877-89a9-6f6dcc4414f1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.014568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201fab-6c14-479c-a851-ecab998be1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.015596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201fab-6c14-479c-a851-ecab998be1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.016088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201fab-6c14-479c-a851-ecab998be1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.016586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201fab-6c14-479c-a851-ecab998be1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.022244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201fab-6c14-479c-a851-ecab998be1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:07.022870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201fab-6c14-479c-a851-ecab998be1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.024146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING py.warnings [None req-21201fab-6c14-479c-a851-ecab998be1b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:31:07.024146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: warnings.warn(msg) Sep 05 12:31:07.024146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: Sep 05 12:31:07.025482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201fab-6c14-479c-a851-ecab998be1b0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.043175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 771/1546] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:31:07.044846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365f33-8d96-43fb-aa8b-25961c0bd52f None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.045414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365f33-8d96-43fb-aa8b-25961c0bd52f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.045917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61365f33-8d96-43fb-aa8b-25961c0bd52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.078490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-61365f33-8d96-43fb-aa8b-25961c0bd52f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.080281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-61365f33-8d96-43fb-aa8b-25961c0bd52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.097158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 772/1547] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.099467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50f44-a2c6-4025-b43c-11a563e9c054 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.099779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50f44-a2c6-4025-b43c-11a563e9c054 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.100084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50f44-a2c6-4025-b43c-11a563e9c054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.135426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2ce50f44-a2c6-4025-b43c-11a563e9c054 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.136706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2ce50f44-a2c6-4025-b43c-11a563e9c054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.144095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 776/1548] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:06 2022] POST /identity/v3/users => generated 297 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:07.144095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8da1d-5784-4877-89a9-6f6dcc4414f1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.154032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 773/1549] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.155459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7758d-5c5a-4ea5-a0cf-a28654facc2b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.155740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7758d-5c5a-4ea5-a0cf-a28654facc2b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.156011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7758d-5c5a-4ea5-a0cf-a28654facc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.172629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8da1d-5784-4877-89a9-6f6dcc4414f1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.179877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3361c-12d8-442c-ac34-60085014d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.181047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3361c-12d8-442c-ac34-60085014d6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.181337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3361c-12d8-442c-ac34-60085014d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.181612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3361c-12d8-442c-ac34-60085014d6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.182591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3361c-12d8-442c-ac34-60085014d6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.183744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-acc3361c-12d8-442c-ac34-60085014d6a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:31:07.183744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: warnings.warn(msg) Sep 05 12:31:07.183744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: Sep 05 12:31:07.184988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3361c-12d8-442c-ac34-60085014d6a6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.186816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-36c7758d-5c5a-4ea5-a0cf-a28654facc2b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.188022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-36c7758d-5c5a-4ea5-a0cf-a28654facc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.201099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 774/1550] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.203095 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658da1-85a6-4709-86ef-ac2da9f47ce7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.203382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658da1-85a6-4709-86ef-ac2da9f47ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.203656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad658da1-85a6-4709-86ef-ac2da9f47ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.225391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ad658da1-85a6-4709-86ef-ac2da9f47ce7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.226610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ad658da1-85a6-4709-86ef-ac2da9f47ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.235057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 775/1551] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.236765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad658da1-85a6-4709-86ef-ac2da9f47ce7 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.247887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad658da1-85a6-4709-86ef-ac2da9f47ce7 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.252848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44ff2d-2427-48ea-b1e9-c8d551b6adcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.255110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ff2d-2427-48ea-b1e9-c8d551b6adcb admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.255110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ff2d-2427-48ea-b1e9-c8d551b6adcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.255110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44ff2d-2427-48ea-b1e9-c8d551b6adcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.255110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44ff2d-2427-48ea-b1e9-c8d551b6adcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.257106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44ff2d-2427-48ea-b1e9-c8d551b6adcb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.268449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 776/1552] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:07.269964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efbde-fed9-4259-a4f5-3da1997255b4 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.270263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efbde-fed9-4259-a4f5-3da1997255b4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.270542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efbde-fed9-4259-a4f5-3da1997255b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.291904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-501efbde-fed9-4259-a4f5-3da1997255b4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.293238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-501efbde-fed9-4259-a4f5-3da1997255b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.301541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 777/1553] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.303532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002e8f-d2c9-4066-aa05-ad9a4e291af6 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.303819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002e8f-d2c9-4066-aa05-ad9a4e291af6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.304098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002e8f-d2c9-4066-aa05-ad9a4e291af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.317540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 777/1554] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:07.319466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bb130-392f-4131-af7b-219c417c6738 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.319736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bb130-392f-4131-af7b-219c417c6738 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.320014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bb130-392f-4131-af7b-219c417c6738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.324729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b2002e8f-d2c9-4066-aa05-ad9a4e291af6 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.329673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b2002e8f-d2c9-4066-aa05-ad9a4e291af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.339644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b61bb130-392f-4131-af7b-219c417c6738 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.340848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b61bb130-392f-4131-af7b-219c417c6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.389567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 778/1555] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.390608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2002e8f-d2c9-4066-aa05-ad9a4e291af6 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.399941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2002e8f-d2c9-4066-aa05-ad9a4e291af6 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.404612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36a44d-21a6-4457-b589-ccc74f2ab716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.405249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36a44d-21a6-4457-b589-ccc74f2ab716 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.405540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36a44d-21a6-4457-b589-ccc74f2ab716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.405814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36a44d-21a6-4457-b589-ccc74f2ab716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.408989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36a44d-21a6-4457-b589-ccc74f2ab716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:07.409146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 778/1556] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.409248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36a44d-21a6-4457-b589-ccc74f2ab716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.409336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036be3-8db5-484e-811f-ef00db176217 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.409336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036be3-8db5-484e-811f-ef00db176217 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.409336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036be3-8db5-484e-811f-ef00db176217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.409547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36a44d-21a6-4457-b589-ccc74f2ab716 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.410120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:07.425539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 779/1557] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:07.425539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d53f-1577-43a3-a5ed-3392e0b0b176 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.426882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d53f-1577-43a3-a5ed-3392e0b0b176 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.426882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d53f-1577-43a3-a5ed-3392e0b0b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.429335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-31036be3-8db5-484e-811f-ef00db176217 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.431117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-31036be3-8db5-484e-811f-ef00db176217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.439751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 779/1558] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.440566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036be3-8db5-484e-811f-ef00db176217 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.447540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b9d6d53f-1577-43a3-a5ed-3392e0b0b176 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.448751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b9d6d53f-1577-43a3-a5ed-3392e0b0b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.455025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036be3-8db5-484e-811f-ef00db176217 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.457882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 780/1559] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.459222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261f4af-a1c4-44d2-8d95-9e1998af6248 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.459607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261f4af-a1c4-44d2-8d95-9e1998af6248 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.459845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261f4af-a1c4-44d2-8d95-9e1998af6248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.462112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49d10-867c-4e81-8cec-0724e211c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.467015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49d10-867c-4e81-8cec-0724e211c49c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.467015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49d10-867c-4e81-8cec-0724e211c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.467015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d49d10-867c-4e81-8cec-0724e211c49c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.467015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d49d10-867c-4e81-8cec-0724e211c49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.467015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d49d10-867c-4e81-8cec-0724e211c49c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.479962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 780/1560] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:07.481917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49d10-867c-4e81-8cec-0724e211c49c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.487859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-d261f4af-a1c4-44d2-8d95-9e1998af6248 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.489130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d261f4af-a1c4-44d2-8d95-9e1998af6248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.493300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d49d10-867c-4e81-8cec-0724e211c49c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.497995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 781/1561] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.498162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2794c-6595-4209-b212-934483fd3f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.498715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2794c-6595-4209-b212-934483fd3f9b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.498880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261f4af-a1c4-44d2-8d95-9e1998af6248 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.499119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2794c-6595-4209-b212-934483fd3f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.499556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2794c-6595-4209-b212-934483fd3f9b admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.500212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2794c-6595-4209-b212-934483fd3f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.502165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2794c-6595-4209-b212-934483fd3f9b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.512241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261f4af-a1c4-44d2-8d95-9e1998af6248 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.517585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fdedb-10b1-459f-9d94-337734e9d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.518187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdedb-10b1-459f-9d94-337734e9d5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.518471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdedb-10b1-459f-9d94-337734e9d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.518755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdedb-10b1-459f-9d94-337734e9d5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.519374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fdedb-10b1-459f-9d94-337734e9d5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:07.519672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fdedb-10b1-459f-9d94-337734e9d5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.521296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fdedb-10b1-459f-9d94-337734e9d5e5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.532872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 782/1562] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:07.534118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8236d5-22a6-4fc3-8bfb-2c15f6720d33 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.534402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8236d5-22a6-4fc3-8bfb-2c15f6720d33 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.534673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8236d5-22a6-4fc3-8bfb-2c15f6720d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.554085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-fb8236d5-22a6-4fc3-8bfb-2c15f6720d33 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.555254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-fb8236d5-22a6-4fc3-8bfb-2c15f6720d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.563252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 783/1563] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.564020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8236d5-22a6-4fc3-8bfb-2c15f6720d33 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.574112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8236d5-22a6-4fc3-8bfb-2c15f6720d33 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.578681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553b3c-7d38-4b2a-a585-1fea05c59466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.586780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553b3c-7d38-4b2a-a585-1fea05c59466 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.586780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553b3c-7d38-4b2a-a585-1fea05c59466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.586780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553b3c-7d38-4b2a-a585-1fea05c59466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.586780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc553b3c-7d38-4b2a-a585-1fea05c59466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.586780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc553b3c-7d38-4b2a-a585-1fea05c59466 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.612961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 781/1564] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:07.616095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c0141-8add-448c-af16-a895c6acdbde None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.616095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c0141-8add-448c-af16-a895c6acdbde None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.616095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c0141-8add-448c-af16-a895c6acdbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.630013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:07.635573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e67c0141-8add-448c-af16-a895c6acdbde None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:07.636776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e67c0141-8add-448c-af16-a895c6acdbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:07.644630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 782/1565] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:07.650084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c0141-8add-448c-af16-a895c6acdbde None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.655605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c0141-8add-448c-af16-a895c6acdbde None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.660212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.660825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.661130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.661411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.662567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:07.662876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.664482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.676565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 783/1566] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:07.684608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 784/1567] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:07.684747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.684863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553b3c-7d38-4b2a-a585-1fea05c59466 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.688251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76748c93-d3bc-4ae5-a66b-bab3cc1cad1a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.743848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553b3c-7d38-4b2a-a585-1fea05c59466 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.744927 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.745630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.745913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.746187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] PATH_INFO: `/v3/projects/a14e33a296124e78ac235d76b5aa9d06/users/567ad9bf5078478a9ef462229bf7f930/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.748675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.749319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.749599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.749898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.750551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:07.750855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.752465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.764419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 785/1568] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:07.765623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.769670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14e33a296124e78ac235d76b5aa9d06, user_id=567ad9bf5078478a9ef462229bf7f930, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.770730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:31:07.770730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: warnings.warn(msg) Sep 05 12:31:07.770730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: Sep 05 12:31:07.773398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.776393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7d765-3d4c-4f81-9788-8eaaad429d57 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.781186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3b8d-784e-4006-a89c-e432c3f940ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.781817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3b8d-784e-4006-a89c-e432c3f940ef admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.782096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3b8d-784e-4006-a89c-e432c3f940ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.782366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac3b8d-784e-4006-a89c-e432c3f940ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.782997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3b8d-784e-4006-a89c-e432c3f940ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:07.785263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac3b8d-784e-4006-a89c-e432c3f940ef admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:07.893001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 784/1569] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:07 2022] PUT /identity/v3/projects/a14e33a296124e78ac235d76b5aa9d06/users/567ad9bf5078478a9ef462229bf7f930/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:07.893851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.923938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 786/1570] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:07 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:07.925429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3b8d-784e-4006-a89c-e432c3f940ef admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:07.960612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec01b-be8c-4317-b80b-b8f6f2a14493 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.991152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac3b8d-784e-4006-a89c-e432c3f940ef admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:07.996387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f8666-fca0-4f05-bcd8-458b8723cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:07.997024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f8666-fca0-4f05-bcd8-458b8723cab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:07.997313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f8666-fca0-4f05-bcd8-458b8723cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:07.997591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f8666-fca0-4f05-bcd8-458b8723cab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:07.998242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f8666-fca0-4f05-bcd8-458b8723cab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.000002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f8666-fca0-4f05-bcd8-458b8723cab2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.012848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 787/1571] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:08.014062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f8666-fca0-4f05-bcd8-458b8723cab2 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.024487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f8666-fca0-4f05-bcd8-458b8723cab2 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.025209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.025835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.026119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.026521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.027187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:08.027494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.029165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.029288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.029813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.030100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.030371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.031019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:08.031324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.032966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.038923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:08.041690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 785/1572] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:08.042506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.051233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 788/1573] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:08.052248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.052402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666bce-526f-4873-98c6-df1ed5ae3f5b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.059839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b3e05-2182-4e39-9260-81f5363ca3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.060720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b3e05-2182-4e39-9260-81f5363ca3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.061041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b3e05-2182-4e39-9260-81f5363ca3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.061340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b3e05-2182-4e39-9260-81f5363ca3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.061986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b3e05-2182-4e39-9260-81f5363ca3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.063963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b3e05-2182-4e39-9260-81f5363ca3b2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.065021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83f60a-f210-4551-b9bd-48ef2bf175f2 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.069728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652176d-d488-446c-b1d7-e930574442a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.070328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652176d-d488-446c-b1d7-e930574442a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.070616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652176d-d488-446c-b1d7-e930574442a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.070891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652176d-d488-446c-b1d7-e930574442a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.071546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652176d-d488-446c-b1d7-e930574442a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.073484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652176d-d488-446c-b1d7-e930574442a5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.074649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:08.162041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 786/1574] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:08.163584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b3e05-2182-4e39-9260-81f5363ca3b2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.172925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b3e05-2182-4e39-9260-81f5363ca3b2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.177846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79781-4cf1-4788-983d-dcdc5d9feb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.178425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79781-4cf1-4788-983d-dcdc5d9feb08 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.178709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79781-4cf1-4788-983d-dcdc5d9feb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.178984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a79781-4cf1-4788-983d-dcdc5d9feb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.179639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79781-4cf1-4788-983d-dcdc5d9feb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.181604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a79781-4cf1-4788-983d-dcdc5d9feb08 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.191815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 789/1575] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:08.193532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df721e8-92b3-4cff-b481-c17b55800893 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.194334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df721e8-92b3-4cff-b481-c17b55800893 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.194623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df721e8-92b3-4cff-b481-c17b55800893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.214024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4df721e8-92b3-4cff-b481-c17b55800893 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:08.215319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4df721e8-92b3-4cff-b481-c17b55800893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:08.272130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 787/1576] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:08.272130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79781-4cf1-4788-983d-dcdc5d9feb08 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.279217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 790/1577] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:08.280120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df721e8-92b3-4cff-b481-c17b55800893 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.290667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df721e8-92b3-4cff-b481-c17b55800893 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.337895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a79781-4cf1-4788-983d-dcdc5d9feb08 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.343397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26479cd-780e-400b-9609-2bbfe32bae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.344015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26479cd-780e-400b-9609-2bbfe32bae70 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.344299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26479cd-780e-400b-9609-2bbfe32bae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.344576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26479cd-780e-400b-9609-2bbfe32bae70 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.345249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26479cd-780e-400b-9609-2bbfe32bae70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.347230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26479cd-780e-400b-9609-2bbfe32bae70 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.348408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09a58d-f249-436c-9ac5-f1fa0309d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.349049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09a58d-f249-436c-9ac5-f1fa0309d9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.349332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09a58d-f249-436c-9ac5-f1fa0309d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.349711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09a58d-f249-436c-9ac5-f1fa0309d9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.351053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09a58d-f249-436c-9ac5-f1fa0309d9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.352666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09a58d-f249-436c-9ac5-f1fa0309d9cb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.363012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 791/1578] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:08.363948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09a58d-f249-436c-9ac5-f1fa0309d9cb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.373557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09a58d-f249-436c-9ac5-f1fa0309d9cb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.378151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc5a56-0d6c-4eed-80a8-1a5d0291bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.378718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc5a56-0d6c-4eed-80a8-1a5d0291bedb admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.378993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc5a56-0d6c-4eed-80a8-1a5d0291bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.379260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc5a56-0d6c-4eed-80a8-1a5d0291bedb admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.379877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc5a56-0d6c-4eed-80a8-1a5d0291bedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.382336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc5a56-0d6c-4eed-80a8-1a5d0291bedb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.447805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 788/1579] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:08.448766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26479cd-780e-400b-9609-2bbfe32bae70 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.458345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26479cd-780e-400b-9609-2bbfe32bae70 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.463684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0ece-bc74-4a61-8dbf-72c01dbbab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.464189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0ece-bc74-4a61-8dbf-72c01dbbab81 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.464471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0ece-bc74-4a61-8dbf-72c01dbbab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.464748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0ece-bc74-4a61-8dbf-72c01dbbab81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.465669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0ece-bc74-4a61-8dbf-72c01dbbab81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.467360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0ece-bc74-4a61-8dbf-72c01dbbab81 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.501388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 792/1580] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:08.502230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc5a56-0d6c-4eed-80a8-1a5d0291bedb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.555199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:08.569799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc5a56-0d6c-4eed-80a8-1a5d0291bedb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.574585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb347f-f75c-4e34-9de4-b57c4cb6d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.575192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb347f-f75c-4e34-9de4-b57c4cb6d1bb admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.575477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb347f-f75c-4e34-9de4-b57c4cb6d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.575751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb347f-f75c-4e34-9de4-b57c4cb6d1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.576393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb347f-f75c-4e34-9de4-b57c4cb6d1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.578054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb347f-f75c-4e34-9de4-b57c4cb6d1bb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.588591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 793/1581] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:08.589405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb347f-f75c-4e34-9de4-b57c4cb6d1bb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.599185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb347f-f75c-4e34-9de4-b57c4cb6d1bb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.602943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 789/1582] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:08.603773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0ece-bc74-4a61-8dbf-72c01dbbab81 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.606733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.607333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.607962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.608243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.608869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.609924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING py.warnings [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:31:08.609924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: warnings.warn(msg) Sep 05 12:31:08.609924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: Sep 05 12:31:08.611171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.669260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0ece-bc74-4a61-8dbf-72c01dbbab81 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.674001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b422-e225-43db-8c5e-83e582087d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.674873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b422-e225-43db-8c5e-83e582087d2a admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.675158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b422-e225-43db-8c5e-83e582087d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.675439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b422-e225-43db-8c5e-83e582087d2a admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.678805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 794/1583] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:08.681325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b422-e225-43db-8c5e-83e582087d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.681453 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.681551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b422-e225-43db-8c5e-83e582087d2a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.732043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a96b2-7c7e-4ec0-a4c2-15d627c4e6a2 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.735436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 790/1584] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:08.735436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b422-e225-43db-8c5e-83e582087d2a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.743725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b422-e225-43db-8c5e-83e582087d2a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.748464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d42d60-265a-4604-a1bc-ca3dcdc97256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.749163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d42d60-265a-4604-a1bc-ca3dcdc97256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.749455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d42d60-265a-4604-a1bc-ca3dcdc97256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.749733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d42d60-265a-4604-a1bc-ca3dcdc97256 admin admin] PATH_INFO: `/v3/projects/b36f32d54f934ed796077c0253081559/users/2dfd3630ab154bfca63048bcecc758c9/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.765168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d42d60-265a-4604-a1bc-ca3dcdc97256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36f32d54f934ed796077c0253081559, user_id=2dfd3630ab154bfca63048bcecc758c9, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.767843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d42d60-265a-4604-a1bc-ca3dcdc97256 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.784331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430435f-8570-408c-bbf9-905ff00a0440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.785052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430435f-8570-408c-bbf9-905ff00a0440 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.785319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430435f-8570-408c-bbf9-905ff00a0440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.785585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430435f-8570-408c-bbf9-905ff00a0440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.794487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430435f-8570-408c-bbf9-905ff00a0440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.795933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430435f-8570-408c-bbf9-905ff00a0440 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.805880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 795/1585] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:08.807354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430435f-8570-408c-bbf9-905ff00a0440 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.816231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430435f-8570-408c-bbf9-905ff00a0440 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.823277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcf0f8-2416-4b31-88e6-1a4fe13896ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.825250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf0f8-2416-4b31-88e6-1a4fe13896ac admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.825250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf0f8-2416-4b31-88e6-1a4fe13896ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.825250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcf0f8-2416-4b31-88e6-1a4fe13896ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.825250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcf0f8-2416-4b31-88e6-1a4fe13896ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.827493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcf0f8-2416-4b31-88e6-1a4fe13896ac admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.830525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 791/1586] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:08 2022] PUT /identity/v3/projects/b36f32d54f934ed796077c0253081559/users/2dfd3630ab154bfca63048bcecc758c9/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:08.831373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d42d60-265a-4604-a1bc-ca3dcdc97256 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.841252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:08.845078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 796/1587] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:08.845078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcf0f8-2416-4b31-88e6-1a4fe13896ac admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.854432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcf0f8-2416-4b31-88e6-1a4fe13896ac admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.914018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d42d60-265a-4604-a1bc-ca3dcdc97256 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.918950 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fe040-42dc-477b-b0e4-e418e663f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.919653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fe040-42dc-477b-b0e4-e418e663f094 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.919898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fe040-42dc-477b-b0e4-e418e663f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.920190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fe040-42dc-477b-b0e4-e418e663f094 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.920889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fe040-42dc-477b-b0e4-e418e663f094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.922942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fe040-42dc-477b-b0e4-e418e663f094 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.923207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5a74f-bd46-45a5-bb3a-1980cf1e6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.923958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5a74f-bd46-45a5-bb3a-1980cf1e6330 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.924244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5a74f-bd46-45a5-bb3a-1980cf1e6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.924810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5a74f-bd46-45a5-bb3a-1980cf1e6330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.925491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5a74f-bd46-45a5-bb3a-1980cf1e6330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.927083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5a74f-bd46-45a5-bb3a-1980cf1e6330 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.940393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 797/1588] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:08.940393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5a74f-bd46-45a5-bb3a-1980cf1e6330 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:08.950809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5a74f-bd46-45a5-bb3a-1980cf1e6330 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:08.959377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd06c2c-04e5-41e3-bf70-ca48c569d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:08.959377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06c2c-04e5-41e3-bf70-ca48c569d781 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:08.959377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06c2c-04e5-41e3-bf70-ca48c569d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:08.959377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd06c2c-04e5-41e3-bf70-ca48c569d781 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:08.959788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd06c2c-04e5-41e3-bf70-ca48c569d781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:08.960498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd06c2c-04e5-41e3-bf70-ca48c569d781 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:08.969862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:09.042655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 798/1589] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:09.043407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 792/1590] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:08 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:09.043622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd06c2c-04e5-41e3-bf70-ca48c569d781 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.044873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fe040-42dc-477b-b0e4-e418e663f094 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.056583 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fe040-42dc-477b-b0e4-e418e663f094 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.056718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd06c2c-04e5-41e3-bf70-ca48c569d781 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.061459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f42085-d53b-4abe-b97e-705db6833c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.061916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f757e-01f2-4395-9504-02fe3446ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.062103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42085-d53b-4abe-b97e-705db6833c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.062393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42085-d53b-4abe-b97e-705db6833c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.062521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f757e-01f2-4395-9504-02fe3446ca94 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.062794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42085-d53b-4abe-b97e-705db6833c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.062915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f757e-01f2-4395-9504-02fe3446ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.063108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f757e-01f2-4395-9504-02fe3446ca94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.063381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f42085-d53b-4abe-b97e-705db6833c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.063764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f757e-01f2-4395-9504-02fe3446ca94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.065009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f42085-d53b-4abe-b97e-705db6833c38 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.065455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f757e-01f2-4395-9504-02fe3446ca94 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.076879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 793/1591] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.077810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60778c-ab40-421f-bdcd-b0611247bdf9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.078104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60778c-ab40-421f-bdcd-b0611247bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.078380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60778c-ab40-421f-bdcd-b0611247bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.079805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 799/1592] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.080648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f42085-d53b-4abe-b97e-705db6833c38 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.091875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f42085-d53b-4abe-b97e-705db6833c38 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.096683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf68f6f-c10c-45ff-a826-7de83140dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.097330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68f6f-c10c-45ff-a826-7de83140dac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.097608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68f6f-c10c-45ff-a826-7de83140dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.097882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf68f6f-c10c-45ff-a826-7de83140dac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.098520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf68f6f-c10c-45ff-a826-7de83140dac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.098737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2c60778c-ab40-421f-bdcd-b0611247bdf9 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:09.100495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2c60778c-ab40-421f-bdcd-b0611247bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:09.100697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf68f6f-c10c-45ff-a826-7de83140dac7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.111445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 800/1593] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.112142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf68f6f-c10c-45ff-a826-7de83140dac7 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.113352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 794/1594] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:09.121552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60778c-ab40-421f-bdcd-b0611247bdf9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.126754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf68f6f-c10c-45ff-a826-7de83140dac7 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.127671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60778c-ab40-421f-bdcd-b0611247bdf9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.131910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69bf7c-8837-43b9-861d-92f9b89f7e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.132793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69bf7c-8837-43b9-861d-92f9b89f7e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.133261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69bf7c-8837-43b9-861d-92f9b89f7e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.133372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6da68-44a0-4c5f-a242-c9d0ade77d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.133582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69bf7c-8837-43b9-861d-92f9b89f7e1e admin admin] PATH_INFO: `/v3/projects/f04b25a0fa2141699d19ba530198e4fc/users/8b016f7487c546c1ab2cd0ff815099f7/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.133985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6da68-44a0-4c5f-a242-c9d0ade77d5b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.134328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6da68-44a0-4c5f-a242-c9d0ade77d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.134544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6da68-44a0-4c5f-a242-c9d0ade77d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.135196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6da68-44a0-4c5f-a242-c9d0ade77d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.136890 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6da68-44a0-4c5f-a242-c9d0ade77d5b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.148933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 795/1595] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.148933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6da68-44a0-4c5f-a242-c9d0ade77d5b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.154149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69bf7c-8837-43b9-861d-92f9b89f7e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04b25a0fa2141699d19ba530198e4fc, user_id=8b016f7487c546c1ab2cd0ff815099f7, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.157595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69bf7c-8837-43b9-861d-92f9b89f7e1e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.158769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6da68-44a0-4c5f-a242-c9d0ade77d5b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.164780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ba78e-7e85-4bd4-b0d9-ec41a2f59122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.165656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ba78e-7e85-4bd4-b0d9-ec41a2f59122 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.165934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ba78e-7e85-4bd4-b0d9-ec41a2f59122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.166214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ba78e-7e85-4bd4-b0d9-ec41a2f59122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.166873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ba78e-7e85-4bd4-b0d9-ec41a2f59122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.168530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ba78e-7e85-4bd4-b0d9-ec41a2f59122 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.180930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 796/1596] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.181833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ba78e-7e85-4bd4-b0d9-ec41a2f59122 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.192369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ba78e-7e85-4bd4-b0d9-ec41a2f59122 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.197372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0660c-88c1-44b7-95ed-543210b6ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.197995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0660c-88c1-44b7-95ed-543210b6ac62 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.198278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0660c-88c1-44b7-95ed-543210b6ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.198554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0660c-88c1-44b7-95ed-543210b6ac62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.199208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0660c-88c1-44b7-95ed-543210b6ac62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.200972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0660c-88c1-44b7-95ed-543210b6ac62 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.215842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 797/1597] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.215842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0660c-88c1-44b7-95ed-543210b6ac62 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.222946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 801/1598] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:09 2022] PUT /identity/v3/projects/f04b25a0fa2141699d19ba530198e4fc/users/8b016f7487c546c1ab2cd0ff815099f7/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:09.228318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69bf7c-8837-43b9-861d-92f9b89f7e1e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.229707 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0660c-88c1-44b7-95ed-543210b6ac62 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.295362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ce109-277d-42a2-a686-517f5829a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.296423 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ce109-277d-42a2-a686-517f5829a93a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.296711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ce109-277d-42a2-a686-517f5829a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.297049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ce109-277d-42a2-a686-517f5829a93a admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.297685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ce109-277d-42a2-a686-517f5829a93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.299753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ce109-277d-42a2-a686-517f5829a93a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.300264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69bf7c-8837-43b9-861d-92f9b89f7e1e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.305769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705887c-0744-4c26-8cc9-a8ce87fd862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.306795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705887c-0744-4c26-8cc9-a8ce87fd862b admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.306928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705887c-0744-4c26-8cc9-a8ce87fd862b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.307131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705887c-0744-4c26-8cc9-a8ce87fd862b admin admin] PATH_INFO: `/v3/projects/189c9f82d1bf4988a4406feb45703bd8/users/d3981eb9530b43d9b9f7d8366a32ee1e/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.315465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 798/1599] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.315465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ce109-277d-42a2-a686-517f5829a93a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.330412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705887c-0744-4c26-8cc9-a8ce87fd862b admin admin] RBAC: Authorizing `identity:create_grant(project_id=189c9f82d1bf4988a4406feb45703bd8, user_id=d3981eb9530b43d9b9f7d8366a32ee1e, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.335136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705887c-0744-4c26-8cc9-a8ce87fd862b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.366710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:09.378955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ce109-277d-42a2-a686-517f5829a93a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.382892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de5834-629c-4d13-ae3e-38ae6101e247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.383499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5834-629c-4d13-ae3e-38ae6101e247 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.383781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5834-629c-4d13-ae3e-38ae6101e247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.384055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de5834-629c-4d13-ae3e-38ae6101e247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.393125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de5834-629c-4d13-ae3e-38ae6101e247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.402239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de5834-629c-4d13-ae3e-38ae6101e247 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.404120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 799/1600] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:09.405000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de5834-629c-4d13-ae3e-38ae6101e247 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.414651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de5834-629c-4d13-ae3e-38ae6101e247 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.420395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 802/1601] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:09 2022] PUT /identity/v3/projects/189c9f82d1bf4988a4406feb45703bd8/users/d3981eb9530b43d9b9f7d8366a32ee1e/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:09.421574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705887c-0744-4c26-8cc9-a8ce87fd862b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.491812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ed764-97df-4cd2-9033-9e77c10f99ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.492617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ed764-97df-4cd2-9033-9e77c10f99ab admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.492906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ed764-97df-4cd2-9033-9e77c10f99ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.493244 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ed764-97df-4cd2-9033-9e77c10f99ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.493866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ed764-97df-4cd2-9033-9e77c10f99ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.495492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ed764-97df-4cd2-9033-9e77c10f99ab admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.505301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705887c-0744-4c26-8cc9-a8ce87fd862b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.511366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7e8c-0d41-4a14-82ad-80c5deb59d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.511679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 800/1602] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.512143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7e8c-0d41-4a14-82ad-80c5deb59d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.512772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7e8c-0d41-4a14-82ad-80c5deb59d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.512894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ed764-97df-4cd2-9033-9e77c10f99ab admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.513276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7e8c-0d41-4a14-82ad-80c5deb59d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.514249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7e8c-0d41-4a14-82ad-80c5deb59d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.516220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7e8c-0d41-4a14-82ad-80c5deb59d20 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.524843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ed764-97df-4cd2-9033-9e77c10f99ab admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.529081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 803/1603] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:09.530941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cae27-b649-4f16-a048-b9e6ada4979b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.531264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cae27-b649-4f16-a048-b9e6ada4979b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.532280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cae27-b649-4f16-a048-b9e6ada4979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.534287 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0907e-0461-4038-8857-2bfbf27704f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.535258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0907e-0461-4038-8857-2bfbf27704f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.535788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0907e-0461-4038-8857-2bfbf27704f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.536330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0907e-0461-4038-8857-2bfbf27704f3 admin admin] PATH_INFO: `/v3/projects/0743526850764b19bde1d1584126ec5c/users/4886d660b855440b8e7bd5a4631067af/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.557411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0907e-0461-4038-8857-2bfbf27704f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0743526850764b19bde1d1584126ec5c, user_id=4886d660b855440b8e7bd5a4631067af, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.558257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e65cae27-b649-4f16-a048-b9e6ada4979b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:09.559677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e65cae27-b649-4f16-a048-b9e6ada4979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:09.561714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0907e-0461-4038-8857-2bfbf27704f3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.569939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 804/1604] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:09.570659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cae27-b649-4f16-a048-b9e6ada4979b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.581462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cae27-b649-4f16-a048-b9e6ada4979b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.590450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c0884-b309-4481-b48a-b125e40d014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.591163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0884-b309-4481-b48a-b125e40d014b admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.591447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0884-b309-4481-b48a-b125e40d014b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.592068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c0884-b309-4481-b48a-b125e40d014b admin admin] PATH_INFO: `/v3/projects/463c0fe5d7d744cf86d2ea88b3b2354d/users/c003200dbe504b68a69ab5ba458c5359/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.615106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c0884-b309-4481-b48a-b125e40d014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=463c0fe5d7d744cf86d2ea88b3b2354d, user_id=c003200dbe504b68a69ab5ba458c5359, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.618298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c0884-b309-4481-b48a-b125e40d014b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.622418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:09.698504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 801/1605] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:09 2022] PUT /identity/v3/projects/0743526850764b19bde1d1584126ec5c/users/4886d660b855440b8e7bd5a4631067af/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:09.699761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298e5d-bb5f-4805-81ce-46a4c8069e8a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.700048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298e5d-bb5f-4805-81ce-46a4c8069e8a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.700322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72298e5d-bb5f-4805-81ce-46a4c8069e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.730941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 805/1606] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:09 2022] PUT /identity/v3/projects/463c0fe5d7d744cf86d2ea88b3b2354d/users/c003200dbe504b68a69ab5ba458c5359/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:09.735023 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c0884-b309-4481-b48a-b125e40d014b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.735662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-72298e5d-bb5f-4805-81ce-46a4c8069e8a None None] MFA Rules not processed for user `d3981eb9530b43d9b9f7d8366a32ee1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:09.737218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-72298e5d-bb5f-4805-81ce-46a4c8069e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:09.845825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 802/1607] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:09.851761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72298e5d-bb5f-4805-81ce-46a4c8069e8a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:09.854375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c0884-b309-4481-b48a-b125e40d014b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.867524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790cf2c-dff8-4f2f-9aa1-aa4bd30445b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.867524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790cf2c-dff8-4f2f-9aa1-aa4bd30445b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.867524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790cf2c-dff8-4f2f-9aa1-aa4bd30445b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.867524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790cf2c-dff8-4f2f-9aa1-aa4bd30445b6 admin admin] PATH_INFO: `/v3/projects/495ba1ac5b8843f59f3ab689a1bdae53/users/4ac91d9adcf244a6bc7de4a98c565de8/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.870000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72298e5d-bb5f-4805-81ce-46a4c8069e8a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:09.875848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281b0e6-d544-44a7-9f20-4d2b2934d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:09.877652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b0e6-d544-44a7-9f20-4d2b2934d023 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:09.878155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b0e6-d544-44a7-9f20-4d2b2934d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:09.878585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b0e6-d544-44a7-9f20-4d2b2934d023 admin admin] PATH_INFO: `/v3/projects/c1776c939a984bd497f613f3b07c1657/users/457d3a58fbd34c2c8d5e082e58b56134/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:09.891182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790cf2c-dff8-4f2f-9aa1-aa4bd30445b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495ba1ac5b8843f59f3ab689a1bdae53, user_id=4ac91d9adcf244a6bc7de4a98c565de8, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.894437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790cf2c-dff8-4f2f-9aa1-aa4bd30445b6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.903201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281b0e6-d544-44a7-9f20-4d2b2934d023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1776c939a984bd497f613f3b07c1657, user_id=457d3a58fbd34c2c8d5e082e58b56134, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:09.908918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281b0e6-d544-44a7-9f20-4d2b2934d023 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:09.978894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 806/1608] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:09 2022] PUT /identity/v3/projects/495ba1ac5b8843f59f3ab689a1bdae53/users/4ac91d9adcf244a6bc7de4a98c565de8/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:09.979892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790cf2c-dff8-4f2f-9aa1-aa4bd30445b6 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:10.017377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 803/1609] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:09 2022] PUT /identity/v3/projects/c1776c939a984bd497f613f3b07c1657/users/457d3a58fbd34c2c8d5e082e58b56134/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:10.018634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b704-9d50-4cd4-a4fe-32c5e49f12c7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.018915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b704-9d50-4cd4-a4fe-32c5e49f12c7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.019260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b704-9d50-4cd4-a4fe-32c5e49f12c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.060859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5686b704-9d50-4cd4-a4fe-32c5e49f12c7 None None] MFA Rules not processed for user `4886d660b855440b8e7bd5a4631067af`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:10.062035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5686b704-9d50-4cd4-a4fe-32c5e49f12c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:10.073365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:10.079558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790cf2c-dff8-4f2f-9aa1-aa4bd30445b6 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:10.165635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb5a16-fb90-4787-a846-d3be1a9a31a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:10.168185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5a16-fb90-4787-a846-d3be1a9a31a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.168185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5a16-fb90-4787-a846-d3be1a9a31a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.168185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb5a16-fb90-4787-a846-d3be1a9a31a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.169082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 804/1610] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:10.170622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475075-a057-4087-b6b1-dee66956b591 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.170940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475075-a057-4087-b6b1-dee66956b591 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.171184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475075-a057-4087-b6b1-dee66956b591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.199436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0a475075-a057-4087-b6b1-dee66956b591 None None] MFA Rules not processed for user `c003200dbe504b68a69ab5ba458c5359`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:10.200771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0a475075-a057-4087-b6b1-dee66956b591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:10.216110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:10.231629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb5a16-fb90-4787-a846-d3be1a9a31a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:10.233122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb5a16-fb90-4787-a846-d3be1a9a31a8 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:10.243090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 807/1611] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:10.244389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3802-e9ed-4724-9754-5f02ed178148 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.244909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3802-e9ed-4724-9754-5f02ed178148 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.244909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3802-e9ed-4724-9754-5f02ed178148 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.246122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 808/1612] 10.222.0.39 () {54 vars in 962 bytes} [Mon Sep 5 12:31:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:31:10.250593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce6f8-0032-4336-8d40-b5b4369bd7b3 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.251130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce6f8-0032-4336-8d40-b5b4369bd7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.257507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ce6f8-0032-4336-8d40-b5b4369bd7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.277585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 805/1613] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:10.278932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4a31-d01d-463e-aeea-a76c245eb594 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.279095 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4d5ce6f8-0032-4336-8d40-b5b4369bd7b3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:10.279414 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4a31-d01d-463e-aeea-a76c245eb594 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.280132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c4a31-d01d-463e-aeea-a76c245eb594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.280776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4d5ce6f8-0032-4336-8d40-b5b4369bd7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:10.295088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 809/1614] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:10.296555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ce6f8-0032-4336-8d40-b5b4369bd7b3 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:10.310106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ce6f8-0032-4336-8d40-b5b4369bd7b3 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:10.315445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-550c4a31-d01d-463e-aeea-a76c245eb594 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:10.316166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520f019-5928-4e8e-82c2-286e5d09a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:10.316986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-550c4a31-d01d-463e-aeea-a76c245eb594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:10.317231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f019-5928-4e8e-82c2-286e5d09a401 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.317579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f019-5928-4e8e-82c2-286e5d09a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.317862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520f019-5928-4e8e-82c2-286e5d09a401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.319652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520f019-5928-4e8e-82c2-286e5d09a401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:10.322981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520f019-5928-4e8e-82c2-286e5d09a401 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:10.327714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 806/1615] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:10.329912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b4026-0452-47de-bbbc-6c4f2b23c788 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.330366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b4026-0452-47de-bbbc-6c4f2b23c788 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.330837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b4026-0452-47de-bbbc-6c4f2b23c788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.376421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c56b4026-0452-47de-bbbc-6c4f2b23c788 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:10.377789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c56b4026-0452-47de-bbbc-6c4f2b23c788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:10.459155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 810/1616] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:10 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:10.460902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b37ab-04e8-430e-9bcd-9f9a4318f105 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.461884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b37ab-04e8-430e-9bcd-9f9a4318f105 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.462580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b37ab-04e8-430e-9bcd-9f9a4318f105 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.466640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 811/1617] 10.222.0.39 () {54 vars in 962 bytes} [Mon Sep 5 12:31:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:31:10.467826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b37ab-04e8-430e-9bcd-9f9a4318f105 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:10.564324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 807/1618] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Sep 5 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:10.565272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b4026-0452-47de-bbbc-6c4f2b23c788 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:10.572476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b37ab-04e8-430e-9bcd-9f9a4318f105 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:10.577611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae62a4-3d83-48c0-a24b-d54a74ff34c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:10.578261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae62a4-3d83-48c0-a24b-d54a74ff34c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.578546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae62a4-3d83-48c0-a24b-d54a74ff34c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.578824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae62a4-3d83-48c0-a24b-d54a74ff34c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.589294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b4026-0452-47de-bbbc-6c4f2b23c788 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:10.605615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c17bc-4584-4632-bd8b-5d02959e081e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:10.606468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c17bc-4584-4632-bd8b-5d02959e081e service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.606810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c17bc-4584-4632-bd8b-5d02959e081e service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.607151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c17bc-4584-4632-bd8b-5d02959e081e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.650781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae62a4-3d83-48c0-a24b-d54a74ff34c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:10.651463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae62a4-3d83-48c0-a24b-d54a74ff34c2 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:10.662770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 812/1619] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:10.663628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae62a4-3d83-48c0-a24b-d54a74ff34c2 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:10.702088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae62a4-3d83-48c0-a24b-d54a74ff34c2 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:10.706883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c17bc-4584-4632-bd8b-5d02959e081e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:10.712219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c17bc-4584-4632-bd8b-5d02959e081e service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:10.720701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a45a-72a1-4177-83aa-c97161fb4bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:10.721613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a45a-72a1-4177-83aa-c97161fb4bed admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.721959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a45a-72a1-4177-83aa-c97161fb4bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.722301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619a45a-72a1-4177-83aa-c97161fb4bed admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.724051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619a45a-72a1-4177-83aa-c97161fb4bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:10.727247 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 808/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:10.729028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619a45a-72a1-4177-83aa-c97161fb4bed admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:10.729175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53c913-f742-477a-970e-645d27035d48 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.729536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53c913-f742-477a-970e-645d27035d48 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.730251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53c913-f742-477a-970e-645d27035d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.756300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0e53c913-f742-477a-970e-645d27035d48 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:10.757796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0e53c913-f742-477a-970e-645d27035d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:10.842922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 809/1621] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Sep 5 12:31:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:10.844021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53c913-f742-477a-970e-645d27035d48 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:10.855740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53c913-f742-477a-970e-645d27035d48 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:10.862432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997f68f-4b04-4d1a-b096-c0800f68d9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:10.863071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f68f-4b04-4d1a-b096-c0800f68d9a9 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.863386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f68f-4b04-4d1a-b096-c0800f68d9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.863662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997f68f-4b04-4d1a-b096-c0800f68d9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.933077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:10.946924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 813/1622] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:10 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:10.948051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a45a-72a1-4177-83aa-c97161fb4bed admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:10.950216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997f68f-4b04-4d1a-b096-c0800f68d9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:10.952541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997f68f-4b04-4d1a-b096-c0800f68d9a9 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:10.973325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619a45a-72a1-4177-83aa-c97161fb4bed admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:10.973537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 810/1623] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:10.975530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997f68f-4b04-4d1a-b096-c0800f68d9a9 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:10.988712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216104a-ab13-4f44-b4df-095c046f8e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:10.989372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216104a-ab13-4f44-b4df-095c046f8e07 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.989657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216104a-ab13-4f44-b4df-095c046f8e07 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.989933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216104a-ab13-4f44-b4df-095c046f8e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:10.991818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997f68f-4b04-4d1a-b096-c0800f68d9a9 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:10.997445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0d74-8822-4098-aa40-73072cf9c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:10.998359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0d74-8822-4098-aa40-73072cf9c908 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:10.998905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0d74-8822-4098-aa40-73072cf9c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:10.999322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0d74-8822-4098-aa40-73072cf9c908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.000105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0d74-8822-4098-aa40-73072cf9c908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:11.002384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0d74-8822-4098-aa40-73072cf9c908 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:11.017914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 811/1624] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:11.022466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0d74-8822-4098-aa40-73072cf9c908 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:11.036129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0d74-8822-4098-aa40-73072cf9c908 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:11.044486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878149c8-f91c-4398-8d0c-266b4886acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:11.045629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878149c8-f91c-4398-8d0c-266b4886acf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.046137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878149c8-f91c-4398-8d0c-266b4886acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.046560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878149c8-f91c-4398-8d0c-266b4886acf1 admin admin] PATH_INFO: `/v3/projects/adb193b50dfd43b9b183cc1d6aab5e7f/users/9bacef9817f343789da2eca8ae745a14/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.067879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878149c8-f91c-4398-8d0c-266b4886acf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb193b50dfd43b9b183cc1d6aab5e7f, user_id=9bacef9817f343789da2eca8ae745a14, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:11.072185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878149c8-f91c-4398-8d0c-266b4886acf1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:11.120047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216104a-ab13-4f44-b4df-095c046f8e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:11.121818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e216104a-ab13-4f44-b4df-095c046f8e07 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:11.145530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 814/1625] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:11.219722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:11.232465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 812/1626] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:11 2022] PUT /identity/v3/projects/adb193b50dfd43b9b183cc1d6aab5e7f/users/9bacef9817f343789da2eca8ae745a14/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:11.232639 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216104a-ab13-4f44-b4df-095c046f8e07 service nova] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:11.259783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216104a-ab13-4f44-b4df-095c046f8e07 service nova] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:11.324508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34c0c-e6e6-4b06-85d5-e689f4777e25 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.325256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34c0c-e6e6-4b06-85d5-e689f4777e25 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.325931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e34c0c-e6e6-4b06-85d5-e689f4777e25 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.329196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 813/1627] 10.222.0.39 () {54 vars in 912 bytes} [Mon Sep 5 12:31:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:31:11.338889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9e89-ec5f-4179-b110-da3cee23c8ce None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.339858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9e89-ec5f-4179-b110-da3cee23c8ce None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.340266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e9e89-ec5f-4179-b110-da3cee23c8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.383886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:11.390180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d30df9-a301-4ba0-88ce-5f56cbc8f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:11.390872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d30df9-a301-4ba0-88ce-5f56cbc8f57f admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.391159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d30df9-a301-4ba0-88ce-5f56cbc8f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.393116 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5a2e9e89-ec5f-4179-b110-da3cee23c8ce None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:11.394323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d30df9-a301-4ba0-88ce-5f56cbc8f57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.396174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d30df9-a301-4ba0-88ce-5f56cbc8f57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:11.397613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5a2e9e89-ec5f-4179-b110-da3cee23c8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:11.404764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d30df9-a301-4ba0-88ce-5f56cbc8f57f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:11.458196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 815/1628] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:11.464672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d30df9-a301-4ba0-88ce-5f56cbc8f57f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:11.492655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d30df9-a301-4ba0-88ce-5f56cbc8f57f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:11.504344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737ec10-dd36-40bd-82fc-2b2e859ad327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:11.505259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ec10-dd36-40bd-82fc-2b2e859ad327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.505700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ec10-dd36-40bd-82fc-2b2e859ad327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.508004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737ec10-dd36-40bd-82fc-2b2e859ad327 admin admin] PATH_INFO: `/v3/projects/adb193b50dfd43b9b183cc1d6aab5e7f/users/9bacef9817f343789da2eca8ae745a14/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.514504 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737ec10-dd36-40bd-82fc-2b2e859ad327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb193b50dfd43b9b183cc1d6aab5e7f, user_id=9bacef9817f343789da2eca8ae745a14, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:11.518257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737ec10-dd36-40bd-82fc-2b2e859ad327 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:11.553685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 816/1629] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:11 2022] PUT /identity/v3/projects/adb193b50dfd43b9b183cc1d6aab5e7f/users/9bacef9817f343789da2eca8ae745a14/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:11.556385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f38fd9-18ed-45d2-ac1d-5bdcd9282c88 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.556754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f38fd9-18ed-45d2-ac1d-5bdcd9282c88 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.556960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f38fd9-18ed-45d2-ac1d-5bdcd9282c88 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.895984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 817/1630] 10.222.0.39 () {54 vars in 912 bytes} [Mon Sep 5 12:31:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:31:11.895984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef39af-3ddb-4178-81e6-014b1d3eead7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.895984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef39af-3ddb-4178-81e6-014b1d3eead7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.895984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef39af-3ddb-4178-81e6-014b1d3eead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.898924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 814/1631] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:31:11.898924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c273a-34e1-482d-831a-4aef3a823017 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.898924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c273a-34e1-482d-831a-4aef3a823017 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.898924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c273a-34e1-482d-831a-4aef3a823017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.903480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-22ef39af-3ddb-4178-81e6-014b1d3eead7 None None] MFA Rules not processed for user `9bacef9817f343789da2eca8ae745a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:11.903480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-22ef39af-3ddb-4178-81e6-014b1d3eead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:11.909138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f02c273a-34e1-482d-831a-4aef3a823017 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:11.909138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f02c273a-34e1-482d-831a-4aef3a823017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:11.909445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 818/1632] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:11.909445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef39af-3ddb-4178-81e6-014b1d3eead7 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:11.909724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 815/1633] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:11.909724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c273a-34e1-482d-831a-4aef3a823017 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:11.910005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef39af-3ddb-4178-81e6-014b1d3eead7 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:11.910005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707dd15-e248-41ac-82e0-8d7e7bcc485a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:11.910005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707dd15-e248-41ac-82e0-8d7e7bcc485a service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.910005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707dd15-e248-41ac-82e0-8d7e7bcc485a service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.910365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707dd15-e248-41ac-82e0-8d7e7bcc485a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.910365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707dd15-e248-41ac-82e0-8d7e7bcc485a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:11.910365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707dd15-e248-41ac-82e0-8d7e7bcc485a service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:11.923099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 819/1634] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:11.927073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c273a-34e1-482d-831a-4aef3a823017 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:11.932214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c54c-2da7-4cbb-acdd-e214eb773b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:11.933096 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c54c-2da7-4cbb-acdd-e214eb773b76 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:11.933611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c54c-2da7-4cbb-acdd-e214eb773b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:11.934029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4c54c-2da7-4cbb-acdd-e214eb773b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:11.946195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4c54c-2da7-4cbb-acdd-e214eb773b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:11.948333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4c54c-2da7-4cbb-acdd-e214eb773b76 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:11.983819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 816/1635] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:12.082002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707dd15-e248-41ac-82e0-8d7e7bcc485a service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:12.132250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707dd15-e248-41ac-82e0-8d7e7bcc485a service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:12.132250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bb356-0098-4233-9dbe-0685a1495394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:12.132250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bb356-0098-4233-9dbe-0685a1495394 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:12.132250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bb356-0098-4233-9dbe-0685a1495394 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:12.132512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bb356-0098-4233-9dbe-0685a1495394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:12.160242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bb356-0098-4233-9dbe-0685a1495394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:12.161739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bb356-0098-4233-9dbe-0685a1495394 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:12.190981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c54c-2da7-4cbb-acdd-e214eb773b76 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:12.195243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 820/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:12.306167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:12.342265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4c54c-2da7-4cbb-acdd-e214eb773b76 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:12.343504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:12.345552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:12.345853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:12.346202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] PATH_INFO: `/v3/users/4886d660b855440b8e7bd5a4631067af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:12.350162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4886d660b855440b8e7bd5a4631067af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:12.351196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:31:12.351196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: warnings.warn(msg) Sep 05 12:31:12.351196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: Sep 05 12:31:12.361840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:12.397013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bb356-0098-4233-9dbe-0685a1495394 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:12.431882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bb356-0098-4233-9dbe-0685a1495394 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:12.447314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:12.448490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:12.449518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:12.451281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] PATH_INFO: `/v3/users/d3981eb9530b43d9b9f7d8366a32ee1e` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:12.454132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3981eb9530b43d9b9f7d8366a32ee1e)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:12.456996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:12.632330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:12.668125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4886d660b855440b8e7bd5a4631067af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.669802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4886d660b855440b8e7bd5a4631067af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.767441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4886d660b855440b8e7bd5a4631067af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.768138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4886d660b855440b8e7bd5a4631067af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.790597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3981eb9530b43d9b9f7d8366a32ee1e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.791662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-659188c9-c963-484a-a0c3-becac51ee6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4886d660b855440b8e7bd5a4631067af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.791795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3981eb9530b43d9b9f7d8366a32ee1e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.817958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 817/1637] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:12 2022] DELETE /identity/v3/users/4886d660b855440b8e7bd5a4631067af => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:12.824564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99810d3-3019-4915-b449-764ed41121be None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:12.825233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99810d3-3019-4915-b449-764ed41121be None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:12.825727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99810d3-3019-4915-b449-764ed41121be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:12.881816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e99810d3-3019-4915-b449-764ed41121be None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:12.884397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e99810d3-3019-4915-b449-764ed41121be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:12.917836 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3981eb9530b43d9b9f7d8366a32ee1e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.956619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3981eb9530b43d9b9f7d8366a32ee1e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.958681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6dc059e-9d7e-457c-b668-2f02a6f17412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3981eb9530b43d9b9f7d8366a32ee1e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:12.987841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 821/1638] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:12 2022] DELETE /identity/v3/users/d3981eb9530b43d9b9f7d8366a32ee1e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:12.989587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ec5b-32af-45e6-9fcc-4ec5870292a4 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:12.989933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ec5b-32af-45e6-9fcc-4ec5870292a4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:12.990256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2ec5b-32af-45e6-9fcc-4ec5870292a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:12.994135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 818/1639] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:13.010786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99810d3-3019-4915-b449-764ed41121be None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:13.017876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e99810d3-3019-4915-b449-764ed41121be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:13.032688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0ff2ec5b-32af-45e6-9fcc-4ec5870292a4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:13.034469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0ff2ec5b-32af-45e6-9fcc-4ec5870292a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:13.201860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99810d3-3019-4915-b449-764ed41121be None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:13.258631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 822/1640] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:13.345176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:13.345823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:13.346160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:13.346439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:13.357830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:13.359975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:13.373177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 819/1641] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:13.473132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ec5b-32af-45e6-9fcc-4ec5870292a4 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:13.474967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0ff2ec5b-32af-45e6-9fcc-4ec5870292a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:13.487435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:13.493828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2ec5b-32af-45e6-9fcc-4ec5870292a4 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:13.501886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0281c9-4523-458f-9ff8-944f7e332d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:13.502843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0281c9-4523-458f-9ff8-944f7e332d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:13.503670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0281c9-4523-458f-9ff8-944f7e332d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:13.504163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0281c9-4523-458f-9ff8-944f7e332d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:13.516340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0281c9-4523-458f-9ff8-944f7e332d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:13.518318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0281c9-4523-458f-9ff8-944f7e332d1f service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:13.536047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 823/1642] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:14.919760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:14.919760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:14.951581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741ffc3-7b22-486b-ae19-981707cf6043 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:14.965562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:14.966428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:14.966717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:14.967007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] PATH_INFO: `/v3/projects/189c9f82d1bf4988a4406feb45703bd8` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:14.968373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=189c9f82d1bf4988a4406feb45703bd8)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:14.970463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:15.118349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189c9f82d1bf4988a4406feb45703bd8', 'request_id': 'req-f01602b3-e8e7-4395-a775-82a1560cb61f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.134087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189c9f82d1bf4988a4406feb45703bd8', 'request_id': 'req-f01602b3-e8e7-4395-a775-82a1560cb61f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.142946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189c9f82d1bf4988a4406feb45703bd8', 'request_id': 'req-f01602b3-e8e7-4395-a775-82a1560cb61f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.259963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] The token cache is being invalidate because project 189c9f82d1bf4988a4406feb45703bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:15.260862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.262881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.267229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 820/1643] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:14 2022] DELETE /identity/v3/projects/189c9f82d1bf4988a4406feb45703bd8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:15.272492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2497-1c71-4a95-a69b-c848e2b9683e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:15.273118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2497-1c71-4a95-a69b-c848e2b9683e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:15.273328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b2497-1c71-4a95-a69b-c848e2b9683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:15.325599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-9c5b2497-1c71-4a95-a69b-c848e2b9683e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:15.326838 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9c5b2497-1c71-4a95-a69b-c848e2b9683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:15.394972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:15.424246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:15.426093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:15.441233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 824/1644] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:15.449599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706558d-f2d1-4e59-a9aa-fb28667f1253 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:15.449928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706558d-f2d1-4e59-a9aa-fb28667f1253 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:15.450193 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706558d-f2d1-4e59-a9aa-fb28667f1253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:15.453409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01602b3-e8e7-4395-a775-82a1560cb61f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:15.469138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:15.471769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:15.474101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:15.474409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] PATH_INFO: `/v3/projects/0743526850764b19bde1d1584126ec5c` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:15.477915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0743526850764b19bde1d1584126ec5c)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:15.480681 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:15.504387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8706558d-f2d1-4e59-a9aa-fb28667f1253 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:15.507024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8706558d-f2d1-4e59-a9aa-fb28667f1253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:15.528618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 825/1645] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:15.532689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706558d-f2d1-4e59-a9aa-fb28667f1253 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:15.545342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706558d-f2d1-4e59-a9aa-fb28667f1253 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:15.550695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:15.551328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:15.551611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:15.551889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:15.553078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:15.553078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:15.555343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:15.571181 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 826/1646] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:15.572184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:15.582483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882839e6-d1a4-45fe-a0a1-7cb551d57465 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:15.614201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0743526850764b19bde1d1584126ec5c', 'request_id': 'req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.637587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0743526850764b19bde1d1584126ec5c', 'request_id': 'req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.647679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:15.647865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:15.648497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:15.648610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:15.650419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:15.653351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:15.657162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0743526850764b19bde1d1584126ec5c', 'request_id': 'req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.758220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] The token cache is being invalidate because project 0743526850764b19bde1d1584126ec5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:15.758880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.762813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:15.781049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 821/1647] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:15 2022] DELETE /identity/v3/projects/0743526850764b19bde1d1584126ec5c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:31:15.787770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:15.801820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:15.806066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 827/1648] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:15 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:15.811834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:15.814230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:15.858913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3981e36-2dab-4a58-80b4-9c7ce5f702b9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:15.875140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:15.984922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:15.984922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:15.984922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:15.985835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34245a30-24bf-4f2e-99b8-e4f254a46baa admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:15.985909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] PATH_INFO: `/v3/users/9bacef9817f343789da2eca8ae745a14` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:15.985909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bacef9817f343789da2eca8ae745a14)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:15.988279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:15.996113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2832c-3f36-4cc7-93c2-e6866972b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:15.996924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2832c-3f36-4cc7-93c2-e6866972b727 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:15.997234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2832c-3f36-4cc7-93c2-e6866972b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:15.997509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2832c-3f36-4cc7-93c2-e6866972b727 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:15.998834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2832c-3f36-4cc7-93c2-e6866972b727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:16.000237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2832c-3f36-4cc7-93c2-e6866972b727 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:16.150463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 828/1649] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:15 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:16.154325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2832c-3f36-4cc7-93c2-e6866972b727 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:16.177358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2832c-3f36-4cc7-93c2-e6866972b727 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:16.188445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d32f78-553c-4a0e-ae34-902749f4cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:16.189369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d32f78-553c-4a0e-ae34-902749f4cacf admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:16.190358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d32f78-553c-4a0e-ae34-902749f4cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:16.190745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d32f78-553c-4a0e-ae34-902749f4cacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:16.192062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d32f78-553c-4a0e-ae34-902749f4cacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:16.194432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d32f78-553c-4a0e-ae34-902749f4cacf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:16.211025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 829/1650] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:16.213036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d32f78-553c-4a0e-ae34-902749f4cacf admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:16.231330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d32f78-553c-4a0e-ae34-902749f4cacf admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:16.237783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188265a8-e5c9-4383-adc0-040707880021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:16.238349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188265a8-e5c9-4383-adc0-040707880021 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:16.238758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188265a8-e5c9-4383-adc0-040707880021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:16.239039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188265a8-e5c9-4383-adc0-040707880021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:16.239699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188265a8-e5c9-4383-adc0-040707880021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:16.243404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188265a8-e5c9-4383-adc0-040707880021 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:16.265170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 830/1651] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:16.266137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188265a8-e5c9-4383-adc0-040707880021 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:16.292673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188265a8-e5c9-4383-adc0-040707880021 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:16.300314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:16.301229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:16.301608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:16.302429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] PATH_INFO: `/v3/projects/7df4d6f7af6448ec9877d86ca44f7636/users/083382ff7dce44d5ad8f398ab391fe0b/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:16.304587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bacef9817f343789da2eca8ae745a14'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:16.305337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bacef9817f343789da2eca8ae745a14'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:16.351466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df4d6f7af6448ec9877d86ca44f7636, user_id=083382ff7dce44d5ad8f398ab391fe0b, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:16.360918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:16.373147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:16.435363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bacef9817f343789da2eca8ae745a14'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:16.436195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bacef9817f343789da2eca8ae745a14'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:16.463209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9bfbd66f-d068-423a-9515-ed9353c2264c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bacef9817f343789da2eca8ae745a14'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:16.497370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 822/1653] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:15 2022] DELETE /identity/v3/users/9bacef9817f343789da2eca8ae745a14 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:16.505696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 831/1653] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:16 2022] PUT /identity/v3/projects/7df4d6f7af6448ec9877d86ca44f7636/users/083382ff7dce44d5ad8f398ab391fe0b/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:16.509676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c4ca-6470-4c6e-82a5-6e3b0c881bab None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:16.512877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c4ca-6470-4c6e-82a5-6e3b0c881bab None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:16.512877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34c4ca-6470-4c6e-82a5-6e3b0c881bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:16.591211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ff34c4ca-6470-4c6e-82a5-6e3b0c881bab None None] MFA Rules not processed for user `083382ff7dce44d5ad8f398ab391fe0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:16.592477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ff34c4ca-6470-4c6e-82a5-6e3b0c881bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:16.871246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:16.871728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 823/1654] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:16.873457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:17.067119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a71c1-c722-4e6e-a395-7a834ae079a4 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:17.215696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328eff-4ffc-4b21-8749-3aabb76695e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:17.218476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328eff-4ffc-4b21-8749-3aabb76695e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:17.219433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328eff-4ffc-4b21-8749-3aabb76695e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:17.221284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328eff-4ffc-4b21-8749-3aabb76695e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:17.221284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a328eff-4ffc-4b21-8749-3aabb76695e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:17.224312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a328eff-4ffc-4b21-8749-3aabb76695e8 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:17.403391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 832/1655] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:16 2022] POST /identity/v3/projects => generated 371 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:17.407709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34c4ca-6470-4c6e-82a5-6e3b0c881bab None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:17.423331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34c4ca-6470-4c6e-82a5-6e3b0c881bab None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:17.471515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:17.541344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58ce2-a6e0-445d-b23c-1945ec32bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:17.543106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58ce2-a6e0-445d-b23c-1945ec32bae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:17.543106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58ce2-a6e0-445d-b23c-1945ec32bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:17.543106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a58ce2-a6e0-445d-b23c-1945ec32bae9 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:17.548940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a58ce2-a6e0-445d-b23c-1945ec32bae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:17.548940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a58ce2-a6e0-445d-b23c-1945ec32bae9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:17.673056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 824/1656] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:17 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:17.676011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328eff-4ffc-4b21-8749-3aabb76695e8 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:17.692295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328eff-4ffc-4b21-8749-3aabb76695e8 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:17.708640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63162-3028-4aa1-9cac-275593d6f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:17.710532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63162-3028-4aa1-9cac-275593d6f570 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:17.710957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63162-3028-4aa1-9cac-275593d6f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:17.711499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63162-3028-4aa1-9cac-275593d6f570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:17.712362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e63162-3028-4aa1-9cac-275593d6f570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:17.714565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e63162-3028-4aa1-9cac-275593d6f570 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:17.739272 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 833/1657] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:17.741446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58ce2-a6e0-445d-b23c-1945ec32bae9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:17.760290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a58ce2-a6e0-445d-b23c-1945ec32bae9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:17.774491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:17.775552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:17.775995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:17.777318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] PATH_INFO: `/v3/projects/50587c7a66b646e0b8abe5f16e7adc19/users/1db3aeff433d42168174fd263802370c/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:17.800913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50587c7a66b646e0b8abe5f16e7adc19, user_id=1db3aeff433d42168174fd263802370c, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:17.806876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:17.946351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 825/1658] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:17 2022] PUT /identity/v3/projects/50587c7a66b646e0b8abe5f16e7adc19/users/1db3aeff433d42168174fd263802370c/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:17.949231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63162-3028-4aa1-9cac-275593d6f570 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:17.963946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63162-3028-4aa1-9cac-275593d6f570 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:18.004033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:18.004033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:18.132512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de47df3-3253-4a70-ac9e-a9bff4762972 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:18.134912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219d60a-06c5-412d-8480-8a662edc9727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:18.135609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d60a-06c5-412d-8480-8a662edc9727 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:18.135944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d60a-06c5-412d-8480-8a662edc9727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:18.136234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219d60a-06c5-412d-8480-8a662edc9727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:18.136896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219d60a-06c5-412d-8480-8a662edc9727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:18.141469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219d60a-06c5-412d-8480-8a662edc9727 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:18.141605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:18.141605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:18.142197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:18.142549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] PATH_INFO: `/v3/users/c003200dbe504b68a69ab5ba458c5359` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:18.144113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c003200dbe504b68a69ab5ba458c5359)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:18.147897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:18.201809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 834/1659] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:18.206861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219d60a-06c5-412d-8480-8a662edc9727 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:18.234599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219d60a-06c5-412d-8480-8a662edc9727 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:18.241461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1e46-9504-416c-8a78-df5096aee921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:18.243512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1e46-9504-416c-8a78-df5096aee921 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:18.243974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1e46-9504-416c-8a78-df5096aee921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:18.244628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1e46-9504-416c-8a78-df5096aee921 admin admin] PATH_INFO: `/v3/projects/50587c7a66b646e0b8abe5f16e7adc19/users/1db3aeff433d42168174fd263802370c/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:18.248077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1e46-9504-416c-8a78-df5096aee921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50587c7a66b646e0b8abe5f16e7adc19, user_id=1db3aeff433d42168174fd263802370c, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:18.254847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1e46-9504-416c-8a78-df5096aee921 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:18.266844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:18.278562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 835/1660] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:18 2022] PUT /identity/v3/projects/50587c7a66b646e0b8abe5f16e7adc19/users/1db3aeff433d42168174fd263802370c/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:18.290078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bc65-e7e9-4820-ad04-0f9f41c8a857 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:18.291900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bc65-e7e9-4820-ad04-0f9f41c8a857 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:18.297881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bc65-e7e9-4820-ad04-0f9f41c8a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:18.355963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-bdd9bc65-e7e9-4820-ad04-0f9f41c8a857 None None] MFA Rules not processed for user `1db3aeff433d42168174fd263802370c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:18.358308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bdd9bc65-e7e9-4820-ad04-0f9f41c8a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:18.421705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c003200dbe504b68a69ab5ba458c5359'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:18.422981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c003200dbe504b68a69ab5ba458c5359'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:18.505305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 836/1661] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:18.512315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9bc65-e7e9-4820-ad04-0f9f41c8a857 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:18.515799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c003200dbe504b68a69ab5ba458c5359'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:18.516554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c003200dbe504b68a69ab5ba458c5359'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:18.518540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bdd9bc65-e7e9-4820-ad04-0f9f41c8a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:18.547303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5c0fff42-d425-4f9c-bfb8-6112335eb1ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c003200dbe504b68a69ab5ba458c5359'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:18.575847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 826/1662] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:17 2022] DELETE /identity/v3/users/c003200dbe504b68a69ab5ba458c5359 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:31:18.583967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548c15-8161-4f82-b185-487137c4a882 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:18.584915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548c15-8161-4f82-b185-487137c4a882 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:18.587400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7548c15-8161-4f82-b185-487137c4a882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:18.634682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e7548c15-8161-4f82-b185-487137c4a882 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:18.638384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e7548c15-8161-4f82-b185-487137c4a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:18.663355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:18.675282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9bc65-e7e9-4820-ad04-0f9f41c8a857 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:18.859280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 827/1663] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:18.871566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:18.872606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:18.873316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:18.873824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:18.900200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7548c15-8161-4f82-b185-487137c4a882 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:18.902517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e7548c15-8161-4f82-b185-487137c4a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:18.996588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:19.026452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:19.028125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:19.048078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7548c15-8161-4f82-b185-487137c4a882 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:19.053846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 837/1664] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:19.063822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:19.064621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:19.064918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:19.065243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:19.082503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:19.084230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:19.099025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 828/1665] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:20.484992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:20.488417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:20.524123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a083ca-6d74-43d9-8a9d-8aa8691d51b3 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:20.538811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:20.540980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:20.542184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:20.542596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] PATH_INFO: `/v3/users/083382ff7dce44d5ad8f398ab391fe0b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:20.545094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] RBAC: Authorizing `identity:delete_user(user_id=083382ff7dce44d5ad8f398ab391fe0b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:20.553124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:20.585418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:20.587098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:20.616062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e352d-d43a-454f-a58a-fe568d197718 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:20.641056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:20.647563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:20.649093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:20.649633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] PATH_INFO: `/v3/projects/adb193b50dfd43b9b183cc1d6aab5e7f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:20.651407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb193b50dfd43b9b183cc1d6aab5e7f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:20.654137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:20.820538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083382ff7dce44d5ad8f398ab391fe0b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:20.822330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083382ff7dce44d5ad8f398ab391fe0b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:20.875771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb193b50dfd43b9b183cc1d6aab5e7f', 'request_id': 'req-eea4f4a7-bd1c-4c82-b722-55611159e4e4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:20.900759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb193b50dfd43b9b183cc1d6aab5e7f', 'request_id': 'req-eea4f4a7-bd1c-4c82-b722-55611159e4e4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:20.913463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb193b50dfd43b9b183cc1d6aab5e7f', 'request_id': 'req-eea4f4a7-bd1c-4c82-b722-55611159e4e4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:20.929444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083382ff7dce44d5ad8f398ab391fe0b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:20.949423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083382ff7dce44d5ad8f398ab391fe0b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:20.950219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083382ff7dce44d5ad8f398ab391fe0b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:20.966460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 838/1666] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:20 2022] DELETE /identity/v3/users/083382ff7dce44d5ad8f398ab391fe0b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:20.967466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:20.973436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:21.023680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] The token cache is being invalidate because project adb193b50dfd43b9b183cc1d6aab5e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:21.024265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:21.027041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eea4f4a7-bd1c-4c82-b722-55611159e4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:21.029449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 829/1667] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:20 2022] DELETE /identity/v3/projects/adb193b50dfd43b9b183cc1d6aab5e7f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:21.031083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b8cc-e0f9-40e0-b375-f855019b6536 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.031716 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b8cc-e0f9-40e0-b375-f855019b6536 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.032171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b8cc-e0f9-40e0-b375-f855019b6536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.076130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3a34b8cc-e0f9-40e0-b375-f855019b6536 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:21.079041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3a34b8cc-e0f9-40e0-b375-f855019b6536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:21.132834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f79b5-6d0d-4dab-a878-b869727b443b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:21.139572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:21.140329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.140742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.141229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] PATH_INFO: `/v3/projects/463c0fe5d7d744cf86d2ea88b3b2354d` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.142611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=463c0fe5d7d744cf86d2ea88b3b2354d)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:21.143858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: WARNING py.warnings [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:31:21.143858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: warnings.warn(msg) Sep 05 12:31:21.143858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: Sep 05 12:31:21.146072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:21.151173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:21.219249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 830/1668] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:21.219249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d441b-f1de-42fd-890d-7883efdcc04f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.219249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d441b-f1de-42fd-890d-7883efdcc04f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.219249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d441b-f1de-42fd-890d-7883efdcc04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.264783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b92d441b-f1de-42fd-890d-7883efdcc04f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:21.266052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b92d441b-f1de-42fd-890d-7883efdcc04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:21.293128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 831/1669] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:21.293128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d441b-f1de-42fd-890d-7883efdcc04f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:21.295571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b92d441b-f1de-42fd-890d-7883efdcc04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:21.327261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463c0fe5d7d744cf86d2ea88b3b2354d', 'request_id': 'req-45c163a0-5747-4e71-85d0-445a4dd74a25'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:21.368095 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463c0fe5d7d744cf86d2ea88b3b2354d', 'request_id': 'req-45c163a0-5747-4e71-85d0-445a4dd74a25'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:21.384992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:21.389415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463c0fe5d7d744cf86d2ea88b3b2354d', 'request_id': 'req-45c163a0-5747-4e71-85d0-445a4dd74a25'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:21.444560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d441b-f1de-42fd-890d-7883efdcc04f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:21.488362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] The token cache is being invalidate because project 463c0fe5d7d744cf86d2ea88b3b2354d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:21.488792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:21.492154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-45c163a0-5747-4e71-85d0-445a4dd74a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:21.500297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 839/1670] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:20 2022] DELETE /identity/v3/projects/463c0fe5d7d744cf86d2ea88b3b2354d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:21.501827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d74cc-5f92-4d59-8946-9a96c060918d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.502118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d74cc-5f92-4d59-8946-9a96c060918d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.502395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d74cc-5f92-4d59-8946-9a96c060918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.545757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e352-dde9-4fdb-abb9-30bac20b861f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:21.547590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-d38d74cc-5f92-4d59-8946-9a96c060918d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:21.547958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e352-dde9-4fdb-abb9-30bac20b861f service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.548490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e352-dde9-4fdb-abb9-30bac20b861f service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.548759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d38d74cc-5f92-4d59-8946-9a96c060918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:21.549250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e352-dde9-4fdb-abb9-30bac20b861f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.551913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c0a5e352-dde9-4fdb-abb9-30bac20b861f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:21.653670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5e352-dde9-4fdb-abb9-30bac20b861f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:21.656696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5e352-dde9-4fdb-abb9-30bac20b861f service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:21.683053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 832/1671] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:21.686202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318b43-fbf0-48b0-801a-39bb1811bcb2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.686498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318b43-fbf0-48b0-801a-39bb1811bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.686780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32318b43-fbf0-48b0-801a-39bb1811bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.690715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 840/1672] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:21.691890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d74cc-5f92-4d59-8946-9a96c060918d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:21.706798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d74cc-5f92-4d59-8946-9a96c060918d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:21.716886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:21.718089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.718568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.719761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.721785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:21.722312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:21.727172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:21.731705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-32318b43-fbf0-48b0-801a-39bb1811bcb2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:21.733089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-32318b43-fbf0-48b0-801a-39bb1811bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:21.747339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 841/1673] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:21.750254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 833/1674] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:21.750527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:21.751685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1408d-925a-4906-9637-160b9a9c590b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.751982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1408d-925a-4906-9637-160b9a9c590b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.752259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1408d-925a-4906-9637-160b9a9c590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.767291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfac85e-6999-460c-8302-9ab4abc234f8 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:21.781274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a70ee-19ad-42f1-b2b1-f449b578df6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:21.781827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a70ee-19ad-42f1-b2b1-f449b578df6b admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.782235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a70ee-19ad-42f1-b2b1-f449b578df6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.782929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a70ee-19ad-42f1-b2b1-f449b578df6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.783335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a70ee-19ad-42f1-b2b1-f449b578df6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:21.785185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a70ee-19ad-42f1-b2b1-f449b578df6b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:21.787827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e6a1408d-925a-4906-9637-160b9a9c590b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:21.789902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e6a1408d-925a-4906-9637-160b9a9c590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:21.803693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 834/1675] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:21.808172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1408d-925a-4906-9637-160b9a9c590b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:21.832820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1408d-925a-4906-9637-160b9a9c590b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:21.842528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:21.843427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.843720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.843996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.844731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:21.845127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:21.847109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:21.866783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 835/1676] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:21.872870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:21.887068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d0bbf-bc50-426a-b592-ee09fdc49be8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:21.892507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ed13c-547b-4a55-a9e6-c8e4876fb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:21.893807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed13c-547b-4a55-a9e6-c8e4876fb296 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:21.894279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed13c-547b-4a55-a9e6-c8e4876fb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:21.894558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed13c-547b-4a55-a9e6-c8e4876fb296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:21.895320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ed13c-547b-4a55-a9e6-c8e4876fb296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:21.897971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ed13c-547b-4a55-a9e6-c8e4876fb296 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:21.963966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 842/1677] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:21 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:21.966336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a70ee-19ad-42f1-b2b1-f449b578df6b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.029170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 836/1678] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:21 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:22.033501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ed13c-547b-4a55-a9e6-c8e4876fb296 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.110437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a70ee-19ad-42f1-b2b1-f449b578df6b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:22.234305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:22.246763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ed13c-547b-4a55-a9e6-c8e4876fb296 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:22.254212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62943d5-7743-4d42-8a49-1252527c6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:22.258281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62943d5-7743-4d42-8a49-1252527c6d13 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.260289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62943d5-7743-4d42-8a49-1252527c6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.260592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62943d5-7743-4d42-8a49-1252527c6d13 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.261317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62943d5-7743-4d42-8a49-1252527c6d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:22.263747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f9f06-6e97-4ad4-b98b-472a97ff5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:22.264404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9f06-6e97-4ad4-b98b-472a97ff5ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.266800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9f06-6e97-4ad4-b98b-472a97ff5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.268523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f9f06-6e97-4ad4-b98b-472a97ff5ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.270233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f9f06-6e97-4ad4-b98b-472a97ff5ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:22.271895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62943d5-7743-4d42-8a49-1252527c6d13 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:22.276075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f9f06-6e97-4ad4-b98b-472a97ff5ea6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:22.386531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 837/1679] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:22 2022] POST /identity/v3/users => generated 289 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:31:22.392493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f9f06-6e97-4ad4-b98b-472a97ff5ea6 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.416524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f9f06-6e97-4ad4-b98b-472a97ff5ea6 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:22.428552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5045a57-efa7-4128-9de5-131bc7dfeff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:22.429953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045a57-efa7-4128-9de5-131bc7dfeff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.431203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045a57-efa7-4128-9de5-131bc7dfeff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.431739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5045a57-efa7-4128-9de5-131bc7dfeff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.432471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5045a57-efa7-4128-9de5-131bc7dfeff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:22.434651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5045a57-efa7-4128-9de5-131bc7dfeff1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:22.439584 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 843/1680] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:21 2022] POST /identity/v3/users => generated 291 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:22.440879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62943d5-7743-4d42-8a49-1252527c6d13 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.471945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 838/1681] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:22.472141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62943d5-7743-4d42-8a49-1252527c6d13 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:22.473972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5045a57-efa7-4128-9de5-131bc7dfeff1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.497807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7d7cd-f521-4cf6-baec-add0230dde3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:22.498659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7d7cd-f521-4cf6-baec-add0230dde3a admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.498747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7d7cd-f521-4cf6-baec-add0230dde3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.498991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7d7cd-f521-4cf6-baec-add0230dde3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.499673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7d7cd-f521-4cf6-baec-add0230dde3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:22.501372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7d7cd-f521-4cf6-baec-add0230dde3a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:22.507787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5045a57-efa7-4128-9de5-131bc7dfeff1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:22.515946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f545f5-c3b6-4c17-913a-852fd12345fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:22.519943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f545f5-c3b6-4c17-913a-852fd12345fd admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.520542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f545f5-c3b6-4c17-913a-852fd12345fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.521030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f545f5-c3b6-4c17-913a-852fd12345fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.523175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f545f5-c3b6-4c17-913a-852fd12345fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:22.529403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 844/1682] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:31:22.530785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f545f5-c3b6-4c17-913a-852fd12345fd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:22.538603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7d7cd-f521-4cf6-baec-add0230dde3a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.551145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 839/1683] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:22.556317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f545f5-c3b6-4c17-913a-852fd12345fd admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.567328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f545f5-c3b6-4c17-913a-852fd12345fd admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:22.568756 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7d7cd-f521-4cf6-baec-add0230dde3a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:22.576123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81b38b-7327-4c5e-bbe6-7a798c891943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:22.577145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b38b-7327-4c5e-bbe6-7a798c891943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.578751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b38b-7327-4c5e-bbe6-7a798c891943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.579111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b38b-7327-4c5e-bbe6-7a798c891943 admin admin] PATH_INFO: `/v3/projects/c1a41de7ab73431a92f34729a7cfad1a/users/454db8580bb846bb94b6438d49fd2c0c/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.589134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab22ce-3abf-4762-8e5d-fe6f37c05cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:22.589776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab22ce-3abf-4762-8e5d-fe6f37c05cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.590061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab22ce-3abf-4762-8e5d-fe6f37c05cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.590766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab22ce-3abf-4762-8e5d-fe6f37c05cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.594164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab22ce-3abf-4762-8e5d-fe6f37c05cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:22.601150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab22ce-3abf-4762-8e5d-fe6f37c05cd1 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:22.605261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81b38b-7327-4c5e-bbe6-7a798c891943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a41de7ab73431a92f34729a7cfad1a, user_id=454db8580bb846bb94b6438d49fd2c0c, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:22.608412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81b38b-7327-4c5e-bbe6-7a798c891943 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:22.637190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 845/1684] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:22.642817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab22ce-3abf-4762-8e5d-fe6f37c05cd1 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.666971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab22ce-3abf-4762-8e5d-fe6f37c05cd1 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:22.680220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc984951-9a45-4417-bfd4-94bf12eeb709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:22.680919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc984951-9a45-4417-bfd4-94bf12eeb709 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.681243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc984951-9a45-4417-bfd4-94bf12eeb709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.681520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc984951-9a45-4417-bfd4-94bf12eeb709 admin admin] PATH_INFO: `/v3/projects/a9253de186804677badae10214f33e09/users/60b10db939f248caa512b936614b16eb/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.695046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 840/1685] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:22 2022] PUT /identity/v3/projects/c1a41de7ab73431a92f34729a7cfad1a/users/454db8580bb846bb94b6438d49fd2c0c/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:22.709599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0e3d-a830-4e57-9892-2d420556f273 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.709937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0e3d-a830-4e57-9892-2d420556f273 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.710169 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca0e3d-a830-4e57-9892-2d420556f273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.725779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc984951-9a45-4417-bfd4-94bf12eeb709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9253de186804677badae10214f33e09, user_id=60b10db939f248caa512b936614b16eb, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:22.728512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc984951-9a45-4417-bfd4-94bf12eeb709 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:22.784830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a3ca0e3d-a830-4e57-9892-2d420556f273 None None] MFA Rules not processed for user `454db8580bb846bb94b6438d49fd2c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:22.786342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a3ca0e3d-a830-4e57-9892-2d420556f273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:22.838340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 846/1686] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:22 2022] PUT /identity/v3/projects/a9253de186804677badae10214f33e09/users/60b10db939f248caa512b936614b16eb/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:22.848737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2736-713c-4dd6-9768-95274625133a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:22.849299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2736-713c-4dd6-9768-95274625133a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:22.849738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a2736-713c-4dd6-9768-95274625133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:22.921225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f33a2736-713c-4dd6-9768-95274625133a None None] MFA Rules not processed for user `60b10db939f248caa512b936614b16eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:22.922965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f33a2736-713c-4dd6-9768-95274625133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:22.974443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 841/1687] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:22.978993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca0e3d-a830-4e57-9892-2d420556f273 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:22.992677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:23.029466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:23.089225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 847/1688] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:23.093957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2736-713c-4dd6-9768-95274625133a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:23.122930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca0e3d-a830-4e57-9892-2d420556f273 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:23.252641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff361a-a1cf-4281-90b0-fee60017e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:23.253560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff361a-a1cf-4281-90b0-fee60017e899 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:23.254210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff361a-a1cf-4281-90b0-fee60017e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:23.255261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff361a-a1cf-4281-90b0-fee60017e899 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:23.257115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a2736-713c-4dd6-9768-95274625133a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:23.258000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff361a-a1cf-4281-90b0-fee60017e899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:23.261266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff361a-a1cf-4281-90b0-fee60017e899 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:23.271776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd741-2647-4671-8eaf-196a1c2db239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:23.274948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd741-2647-4671-8eaf-196a1c2db239 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:23.275800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd741-2647-4671-8eaf-196a1c2db239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:23.275972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd741-2647-4671-8eaf-196a1c2db239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:23.277678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cd741-2647-4671-8eaf-196a1c2db239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:23.285643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cd741-2647-4671-8eaf-196a1c2db239 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:23.384586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 842/1689] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:22 2022] POST /identity/v3/projects => generated 377 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:31:23.385664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff361a-a1cf-4281-90b0-fee60017e899 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:23.432999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 848/1690] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:23 2022] POST /identity/v3/projects => generated 379 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:23.439944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd741-2647-4671-8eaf-196a1c2db239 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:23.508608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff361a-a1cf-4281-90b0-fee60017e899 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:23.619501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd741-2647-4671-8eaf-196a1c2db239 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:23.631547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9d65-35d3-4e86-bafd-2fe52c95af12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:23.633232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9d65-35d3-4e86-bafd-2fe52c95af12 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:23.633602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9d65-35d3-4e86-bafd-2fe52c95af12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:23.633929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9d65-35d3-4e86-bafd-2fe52c95af12 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:23.634641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca9d65-35d3-4e86-bafd-2fe52c95af12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:23.638605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca9d65-35d3-4e86-bafd-2fe52c95af12 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:23.645754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f574d-330b-4711-8a90-7da2a8d23164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:23.646522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f574d-330b-4711-8a90-7da2a8d23164 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:23.646887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f574d-330b-4711-8a90-7da2a8d23164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:23.648353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f574d-330b-4711-8a90-7da2a8d23164 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:23.649142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f574d-330b-4711-8a90-7da2a8d23164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:23.655355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f574d-330b-4711-8a90-7da2a8d23164 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:23.751254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 849/1691] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:23 2022] POST /identity/v3/users => generated 296 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:31:23.754380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 843/1692] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:23 2022] POST /identity/v3/users => generated 295 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:23.760741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9d65-35d3-4e86-bafd-2fe52c95af12 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:23.763751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f574d-330b-4711-8a90-7da2a8d23164 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:23.779653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9d65-35d3-4e86-bafd-2fe52c95af12 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:23.787821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f574d-330b-4711-8a90-7da2a8d23164 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:23.799358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420b535-3c23-4b52-8f78-866fe73cc8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:23.799594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ab8aa-b3b9-44ae-8e2b-bd7917186d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:23.800638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab8aa-b3b9-44ae-8e2b-bd7917186d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:23.801050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab8aa-b3b9-44ae-8e2b-bd7917186d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:23.801502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab8aa-b3b9-44ae-8e2b-bd7917186d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:23.802302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ab8aa-b3b9-44ae-8e2b-bd7917186d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:23.805745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420b535-3c23-4b52-8f78-866fe73cc8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:23.806188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420b535-3c23-4b52-8f78-866fe73cc8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:23.807007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420b535-3c23-4b52-8f78-866fe73cc8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:23.807677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ab8aa-b3b9-44ae-8e2b-bd7917186d1b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:23.808572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420b535-3c23-4b52-8f78-866fe73cc8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:23.810321 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420b535-3c23-4b52-8f78-866fe73cc8b5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:23.837827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 844/1693] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:31:23.842592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ab8aa-b3b9-44ae-8e2b-bd7917186d1b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:23.846535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 850/1694] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:23.856288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420b535-3c23-4b52-8f78-866fe73cc8b5 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:23.872534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420b535-3c23-4b52-8f78-866fe73cc8b5 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:23.878338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ab8aa-b3b9-44ae-8e2b-bd7917186d1b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:23.886836 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eb715-8fa7-4af9-afd7-ad3d6e90d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:23.887947 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb715-8fa7-4af9-afd7-ad3d6e90d45b admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:23.888365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb715-8fa7-4af9-afd7-ad3d6e90d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:23.888774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb715-8fa7-4af9-afd7-ad3d6e90d45b admin admin] PATH_INFO: `/v3/projects/73df88b92ebf44c1a2a787613e37b889/users/062fa6ec3b994902bc8c20e137232c4e/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:23.890750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bd2f-ca40-438a-afc5-b8a3b7fe0e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:23.891552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd2f-ca40-438a-afc5-b8a3b7fe0e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:23.891938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd2f-ca40-438a-afc5-b8a3b7fe0e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:23.892332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9bd2f-ca40-438a-afc5-b8a3b7fe0e0c admin admin] PATH_INFO: `/v3/projects/ddbe81acae694e6bbfa267e6991e633b/users/445ff900d5994a3fa114d6347501a295/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:23.925492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9bd2f-ca40-438a-afc5-b8a3b7fe0e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbe81acae694e6bbfa267e6991e633b, user_id=445ff900d5994a3fa114d6347501a295, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:23.928383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4eb715-8fa7-4af9-afd7-ad3d6e90d45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73df88b92ebf44c1a2a787613e37b889, user_id=062fa6ec3b994902bc8c20e137232c4e, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:23.928546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9bd2f-ca40-438a-afc5-b8a3b7fe0e0c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:23.937683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4eb715-8fa7-4af9-afd7-ad3d6e90d45b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:24.055773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 845/1695] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:23 2022] PUT /identity/v3/projects/ddbe81acae694e6bbfa267e6991e633b/users/445ff900d5994a3fa114d6347501a295/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:24.060233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bd2f-ca40-438a-afc5-b8a3b7fe0e0c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:24.089051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 851/1696] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:23 2022] PUT /identity/v3/projects/73df88b92ebf44c1a2a787613e37b889/users/062fa6ec3b994902bc8c20e137232c4e/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:31:24.097619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eb715-8fa7-4af9-afd7-ad3d6e90d45b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:24.240626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9bd2f-ca40-438a-afc5-b8a3b7fe0e0c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:24.273480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eb715-8fa7-4af9-afd7-ad3d6e90d45b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:24.288226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:24.288585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:24.288867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:24.289346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:24.290038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:24.291880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:24.320854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 852/1697] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:24.321823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:24.324165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:24.329620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:24.358334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a297ca-56d4-4ff2-8beb-1a342cb1da0b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:24.371094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:24.372218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:24.373032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:24.373032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] PATH_INFO: `/v3/projects/7df4d6f7af6448ec9877d86ca44f7636` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:24.375352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bb99b-d843-41e7-8931-edd9a585cced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:24.375540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bb99b-d843-41e7-8931-edd9a585cced admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:24.375693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bb99b-d843-41e7-8931-edd9a585cced admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:24.376552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df4d6f7af6448ec9877d86ca44f7636)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:24.378589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:24.381263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bb99b-d843-41e7-8931-edd9a585cced admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:24.381786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bb99b-d843-41e7-8931-edd9a585cced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:24.383425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bb99b-d843-41e7-8931-edd9a585cced admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:24.403912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 846/1698] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:24.405535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bb99b-d843-41e7-8931-edd9a585cced admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:24.423812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bb99b-d843-41e7-8931-edd9a585cced admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:24.430953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdd2de-c957-4055-a9c4-6f0328d5564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:24.432341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdd2de-c957-4055-a9c4-6f0328d5564f admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:24.432807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdd2de-c957-4055-a9c4-6f0328d5564f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:24.433380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdd2de-c957-4055-a9c4-6f0328d5564f admin admin] PATH_INFO: `/v3/projects/73df88b92ebf44c1a2a787613e37b889/users/062fa6ec3b994902bc8c20e137232c4e/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:24.435746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdd2de-c957-4055-a9c4-6f0328d5564f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73df88b92ebf44c1a2a787613e37b889, user_id=062fa6ec3b994902bc8c20e137232c4e, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:24.439445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdd2de-c957-4055-a9c4-6f0328d5564f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:24.471225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 847/1699] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:24 2022] PUT /identity/v3/projects/73df88b92ebf44c1a2a787613e37b889/users/062fa6ec3b994902bc8c20e137232c4e/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:24.472130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdd2de-c957-4055-a9c4-6f0328d5564f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:24.607222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df4d6f7af6448ec9877d86ca44f7636', 'request_id': 'req-3424f9a2-0489-4624-9fe3-83bb0da44e06'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:24.628136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df4d6f7af6448ec9877d86ca44f7636', 'request_id': 'req-3424f9a2-0489-4624-9fe3-83bb0da44e06'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:24.635973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdd2de-c957-4055-a9c4-6f0328d5564f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:24.641547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df4d6f7af6448ec9877d86ca44f7636', 'request_id': 'req-3424f9a2-0489-4624-9fe3-83bb0da44e06'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:24.658048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:24.747935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] The token cache is being invalidate because project 7df4d6f7af6448ec9877d86ca44f7636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:24.748244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:24.752327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3424f9a2-0489-4624-9fe3-83bb0da44e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:24.752327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 853/1700] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:24 2022] DELETE /identity/v3/projects/7df4d6f7af6448ec9877d86ca44f7636 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:24.752327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a53c6-0008-467e-b538-731d1682e5f0 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:24.752722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a53c6-0008-467e-b538-731d1682e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:24.756823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a53c6-0008-467e-b538-731d1682e5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:24.811031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4897c-5766-4255-bd8f-e1e489688a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:24.814934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4897c-5766-4255-bd8f-e1e489688a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:24.821291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4897c-5766-4255-bd8f-e1e489688a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:24.821291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4897c-5766-4255-bd8f-e1e489688a76 admin admin] PATH_INFO: `/v3/projects/ddbe81acae694e6bbfa267e6991e633b/users/445ff900d5994a3fa114d6347501a295/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:24.821475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ce5a53c6-0008-467e-b538-731d1682e5f0 None None] MFA Rules not processed for user `062fa6ec3b994902bc8c20e137232c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:24.821559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4897c-5766-4255-bd8f-e1e489688a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddbe81acae694e6bbfa267e6991e633b, user_id=445ff900d5994a3fa114d6347501a295, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:24.821635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ce5a53c6-0008-467e-b538-731d1682e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:24.822774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4897c-5766-4255-bd8f-e1e489688a76 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:24.851793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 848/1701] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:24 2022] PUT /identity/v3/projects/ddbe81acae694e6bbfa267e6991e633b/users/445ff900d5994a3fa114d6347501a295/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:24.853486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e27fe-b056-423a-80e9-01763841fda7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:24.853941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e27fe-b056-423a-80e9-01763841fda7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:24.854353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e27fe-b056-423a-80e9-01763841fda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:24.911196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fe9e27fe-b056-423a-80e9-01763841fda7 None None] MFA Rules not processed for user `567ad9bf5078478a9ef462229bf7f930`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:24.914093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fe9e27fe-b056-423a-80e9-01763841fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:25.009703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 849/1702] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:25.010818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e27fe-b056-423a-80e9-01763841fda7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:25.017014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fe9e27fe-b056-423a-80e9-01763841fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:25.123580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 854/1703] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:25.133451 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd947a5-e31b-4151-a78c-cbb6fb272c59 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:25.135447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd947a5-e31b-4151-a78c-cbb6fb272c59 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:25.135904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd947a5-e31b-4151-a78c-cbb6fb272c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:25.202315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e27fe-b056-423a-80e9-01763841fda7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:25.219624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:25.220881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:25.221394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:25.222114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] PATH_INFO: `/v3/users/1db3aeff433d42168174fd263802370c` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:25.224238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db3aeff433d42168174fd263802370c)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:25.230057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:25.240852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-efd947a5-e31b-4151-a78c-cbb6fb272c59 None None] MFA Rules not processed for user `445ff900d5994a3fa114d6347501a295`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:25.242094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-efd947a5-e31b-4151-a78c-cbb6fb272c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:25.389021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:25.472117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 855/1704] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:25.473345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0997-38a0-40f5-8389-e4cb2cb61971 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:25.473637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0997-38a0-40f5-8389-e4cb2cb61971 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:25.473914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d0997-38a0-40f5-8389-e4cb2cb61971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:25.529456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b89d0997-38a0-40f5-8389-e4cb2cb61971 None None] MFA Rules not processed for user `567ad9bf5078478a9ef462229bf7f930`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:25.530693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b89d0997-38a0-40f5-8389-e4cb2cb61971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:25.540855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db3aeff433d42168174fd263802370c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:25.541776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db3aeff433d42168174fd263802370c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:25.543662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 856/1705] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:25.552171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d0997-38a0-40f5-8389-e4cb2cb61971 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:25.564079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b89d0997-38a0-40f5-8389-e4cb2cb61971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:25.640925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db3aeff433d42168174fd263802370c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:25.641853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db3aeff433d42168174fd263802370c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:25.652204 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:25.673710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db3aeff433d42168174fd263802370c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:25.716517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 850/1706] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:25 2022] DELETE /identity/v3/users/1db3aeff433d42168174fd263802370c => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:25.719810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:25.731840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:25.761485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d0997-38a0-40f5-8389-e4cb2cb61971 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:25.898669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc36371-1576-49f9-8df0-5ae2ec587570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:25.900260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc36371-1576-49f9-8df0-5ae2ec587570 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:25.901236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc36371-1576-49f9-8df0-5ae2ec587570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:25.901753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc36371-1576-49f9-8df0-5ae2ec587570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:25.905528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ccc36371-1576-49f9-8df0-5ae2ec587570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:25.922642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3a4a9-f496-4d76-b514-b35c1354cf73 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:25.932743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:25.935363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:25.935909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:25.943972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:25.950113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:26.065221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:26.085239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc36371-1576-49f9-8df0-5ae2ec587570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:26.087301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc36371-1576-49f9-8df0-5ae2ec587570 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:26.101942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:26.103422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:26.104334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 857/1707] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:26.106920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1bc5b-6c39-4864-80b5-0c8db8f0c0d1 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:26.107549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1bc5b-6c39-4864-80b5-0c8db8f0c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:26.107961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1bc5b-6c39-4864-80b5-0c8db8f0c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:26.130480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 851/1708] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:26.134834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:26.137582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:26.200413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0da1bc5b-6c39-4864-80b5-0c8db8f0c0d1 None None] MFA Rules not processed for user `2dfd3630ab154bfca63048bcecc758c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:26.204577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0da1bc5b-6c39-4864-80b5-0c8db8f0c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:26.393479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1a3bc-e8d3-4072-b15b-c841ffd66fab service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:26.409191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:26.409822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:26.410105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:26.410380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:26.414213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 858/1709] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:26.422276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:26.430002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ec8c-4d25-4ab7-b877-823d7d81ddff None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:26.430402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ec8c-4d25-4ab7-b877-823d7d81ddff None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:26.430739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ec8c-4d25-4ab7-b877-823d7d81ddff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:26.495145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a0a5ec8c-4d25-4ab7-b877-823d7d81ddff None None] MFA Rules not processed for user `8b016f7487c546c1ab2cd0ff815099f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:26.496463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a0a5ec8c-4d25-4ab7-b877-823d7d81ddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:26.530715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:26.661313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 859/1710] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:26.663173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0b23-b046-4a62-a6bc-d4ba52956dc4 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:26.663464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0b23-b046-4a62-a6bc-d4ba52956dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:26.664273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0b23-b046-4a62-a6bc-d4ba52956dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:26.702135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ed3c0b23-b046-4a62-a6bc-d4ba52956dc4 None None] MFA Rules not processed for user `2dfd3630ab154bfca63048bcecc758c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:26.703532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ed3c0b23-b046-4a62-a6bc-d4ba52956dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:26.704283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:26.714638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:26.716185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 860/1711] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:26.723541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c0b23-b046-4a62-a6bc-d4ba52956dc4 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:26.727765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ed3c0b23-b046-4a62-a6bc-d4ba52956dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:26.748780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c0b23-b046-4a62-a6bc-d4ba52956dc4 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:26.757556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd65c-bbef-49fe-8671-af4f185d696d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:26.758265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd65c-bbef-49fe-8671-af4f185d696d service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:26.758604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd65c-bbef-49fe-8671-af4f185d696d service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:26.760059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbd65c-bbef-49fe-8671-af4f185d696d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:26.767698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 852/1712] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:26.771657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbd65c-bbef-49fe-8671-af4f185d696d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:26.774768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbd65c-bbef-49fe-8671-af4f185d696d service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:26.789162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 861/1713] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:27.016551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:27.019736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:27.170487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd65c-bbef-49fe-8671-af4f185d696d service nova] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:27.185662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:27.191870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbd65c-bbef-49fe-8671-af4f185d696d service nova] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:27.208010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a1441-d28c-41a8-a868-879f44c2c921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:27.208778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1441-d28c-41a8-a868-879f44c2c921 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:27.210038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1441-d28c-41a8-a868-879f44c2c921 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:27.210323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1441-d28c-41a8-a868-879f44c2c921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:27.232104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a1441-d28c-41a8-a868-879f44c2c921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:27.234369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a1441-d28c-41a8-a868-879f44c2c921 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:27.265122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 862/1714] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:27.271570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39651ec0-4a4c-4124-b375-05b815583271 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:27.287307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:27.289852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:27.291157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:27.292054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] PATH_INFO: `/v3/projects/50587c7a66b646e0b8abe5f16e7adc19` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:27.297527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=50587c7a66b646e0b8abe5f16e7adc19)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:27.303243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:27.527328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50587c7a66b646e0b8abe5f16e7adc19', 'request_id': 'req-f563adb3-c163-49d4-b8c2-f68c08ac60ec'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:27.542035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50587c7a66b646e0b8abe5f16e7adc19', 'request_id': 'req-f563adb3-c163-49d4-b8c2-f68c08ac60ec'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:27.559648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50587c7a66b646e0b8abe5f16e7adc19', 'request_id': 'req-f563adb3-c163-49d4-b8c2-f68c08ac60ec'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:27.673762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] The token cache is being invalidate because project 50587c7a66b646e0b8abe5f16e7adc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:27.674221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:27.676631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f563adb3-c163-49d4-b8c2-f68c08ac60ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:27.680223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 853/1715] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:27 2022] DELETE /identity/v3/projects/50587c7a66b646e0b8abe5f16e7adc19 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:27.685688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763218f9-393e-47a1-ae82-24454c50cc68 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:27.686196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763218f9-393e-47a1-ae82-24454c50cc68 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:27.686196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763218f9-393e-47a1-ae82-24454c50cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:27.717995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-763218f9-393e-47a1-ae82-24454c50cc68 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:27.719472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-763218f9-393e-47a1-ae82-24454c50cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:27.745056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3755-e978-42ea-b025-82a1e3bf8506 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:27.745367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3755-e978-42ea-b025-82a1e3bf8506 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:27.745626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3755-e978-42ea-b025-82a1e3bf8506 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:27.747250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 854/1716] 10.222.0.39 () {54 vars in 912 bytes} [Mon Sep 5 12:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:31:27.755669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063621d8-4ba9-4a41-856f-f2679a008357 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:27.756181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063621d8-4ba9-4a41-856f-f2679a008357 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:27.756599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063621d8-4ba9-4a41-856f-f2679a008357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:27.879048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:27.886728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-063621d8-4ba9-4a41-856f-f2679a008357 None None] MFA Rules not processed for user `fa7ce8d93f864130a3c079b1aec6b678`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:27.894732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-063621d8-4ba9-4a41-856f-f2679a008357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:27.986087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 863/1717] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:27.987353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763218f9-393e-47a1-ae82-24454c50cc68 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:27.990958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-763218f9-393e-47a1-ae82-24454c50cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:28.115801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 855/1718] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:31:28.117631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ae592-7bd2-4fd9-a923-8673236f77c7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.117925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ae592-7bd2-4fd9-a923-8673236f77c7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.118202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ae592-7bd2-4fd9-a923-8673236f77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.148535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-619ae592-7bd2-4fd9-a923-8673236f77c7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:28.152671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-619ae592-7bd2-4fd9-a923-8673236f77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:28.155505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763218f9-393e-47a1-ae82-24454c50cc68 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:28.163805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445ff900d5994a3fa114d6347501a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddbe81acae694e6bbfa267e6991e633b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:28.164636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.165218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.166002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.166908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:28.167366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:28.168978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 856/1719] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:28.169828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:28.174820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ae592-7bd2-4fd9-a923-8673236f77c7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:28.177119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-619ae592-7bd2-4fd9-a923-8673236f77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:28.200687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ae592-7bd2-4fd9-a923-8673236f77c7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:28.212489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d35c0-9759-4c17-be69-9b8f0906e727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:28.212489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d35c0-9759-4c17-be69-9b8f0906e727 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.212489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d35c0-9759-4c17-be69-9b8f0906e727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.212489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d35c0-9759-4c17-be69-9b8f0906e727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.225845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 864/1720] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:28.227346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:28.239035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d35c0-9759-4c17-be69-9b8f0906e727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:28.241903 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d35c0-9759-4c17-be69-9b8f0906e727 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:28.264002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dbc99-db5a-4da7-ab8d-45274c81be53 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:28.278668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 857/1721] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:28.281262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d35c0-9759-4c17-be69-9b8f0906e727 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:28.313640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d35c0-9759-4c17-be69-9b8f0906e727 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:28.323177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:28.324104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.324574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.325014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.328146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04aab-33a9-4829-a4f0-7a3d03f37d3d tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445ff900d5994a3fa114d6347501a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddbe81acae694e6bbfa267e6991e633b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:28.328940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04aab-33a9-4829-a4f0-7a3d03f37d3d tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.329361 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04aab-33a9-4829-a4f0-7a3d03f37d3d tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.331889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04aab-33a9-4829-a4f0-7a3d03f37d3d tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.332771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04aab-33a9-4829-a4f0-7a3d03f37d3d tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:28.335039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:28.335517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:28.338384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a04aab-33a9-4829-a4f0-7a3d03f37d3d tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:28.351141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:28.395373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 865/1722] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:28.401024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:28.429789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b480303-cd0c-4b4e-a86d-2e59555b46d4 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:28.435360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe803f-48d6-4f27-afdd-c3751bd3b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:28.436048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe803f-48d6-4f27-afdd-c3751bd3b42a admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.436332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe803f-48d6-4f27-afdd-c3751bd3b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.436659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe803f-48d6-4f27-afdd-c3751bd3b42a admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.437472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe803f-48d6-4f27-afdd-c3751bd3b42a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:28.439445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe803f-48d6-4f27-afdd-c3751bd3b42a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:28.486791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 858/1723] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:28 2022] POST /identity/v3/projects => generated 354 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:28.498986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04aab-33a9-4829-a4f0-7a3d03f37d3d tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:28.583362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 866/1724] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:28 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:28.585409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886787f-7112-417d-880e-f10b5be6c3c1 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.587283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886787f-7112-417d-880e-f10b5be6c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.587666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886787f-7112-417d-880e-f10b5be6c3c1 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.592912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 867/1725] 10.222.0.39 () {54 vars in 912 bytes} [Mon Sep 5 12:31:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:31:28.598110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886787f-7112-417d-880e-f10b5be6c3c1 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:28.624318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a04aab-33a9-4829-a4f0-7a3d03f37d3d tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:28.645354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:28.831959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886787f-7112-417d-880e-f10b5be6c3c1 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:28.839066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f3b99-eb8c-4c83-ba38-545ac0560305 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445ff900d5994a3fa114d6347501a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddbe81acae694e6bbfa267e6991e633b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:28.840921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3b99-eb8c-4c83-ba38-545ac0560305 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.841766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3b99-eb8c-4c83-ba38-545ac0560305 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.842061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3b99-eb8c-4c83-ba38-545ac0560305 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.843467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f3b99-eb8c-4c83-ba38-545ac0560305 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:28.843782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f3b99-eb8c-4c83-ba38-545ac0560305 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:28.845491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f3b99-eb8c-4c83-ba38-545ac0560305 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:28.847164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509e4ad-5a78-4e57-8606-8f860453c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:28.847792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e4ad-5a78-4e57-8606-8f860453c7bf admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.848075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e4ad-5a78-4e57-8606-8f860453c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.848715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509e4ad-5a78-4e57-8606-8f860453c7bf admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.849453 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509e4ad-5a78-4e57-8606-8f860453c7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:28.852497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509e4ad-5a78-4e57-8606-8f860453c7bf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:28.883366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 859/1726] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:28.897955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cfa4f-5787-4a92-8acd-64cad5610311 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:28.905954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:28.908757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cfa4f-5787-4a92-8acd-64cad5610311 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:28.909145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cfa4f-5787-4a92-8acd-64cad5610311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:28.967723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 868/1727] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:28 2022] POST /identity/v3/users => generated 281 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:28.978312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509e4ad-5a78-4e57-8606-8f860453c7bf admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:29.000236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509e4ad-5a78-4e57-8606-8f860453c7bf admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:29.016446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '445ff900d5994a3fa114d6347501a295', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddbe81acae694e6bbfa267e6991e633b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:29.018016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:29.018458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:29.018881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] PATH_INFO: `/v3/projects/361ea7f0675b4d0f9813bf4eed0e31e2` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:29.020025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-458cfa4f-5787-4a92-8acd-64cad5610311 None None] MFA Rules not processed for user `fa7ce8d93f864130a3c079b1aec6b678`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:29.020817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Authorizing `identity:delete_project(project_id=361ea7f0675b4d0f9813bf4eed0e31e2)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:29.023729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:29.025683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-458cfa4f-5787-4a92-8acd-64cad5610311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:29.216454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 860/1728] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:29.218529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cfa4f-5787-4a92-8acd-64cad5610311 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:29.274617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cfa4f-5787-4a92-8acd-64cad5610311 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:29.300705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361ea7f0675b4d0f9813bf4eed0e31e2', 'request_id': 'req-4745c349-6272-45f9-a57e-962d6dab8493'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:29.317660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361ea7f0675b4d0f9813bf4eed0e31e2', 'request_id': 'req-4745c349-6272-45f9-a57e-962d6dab8493'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:29.341138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361ea7f0675b4d0f9813bf4eed0e31e2', 'request_id': 'req-4745c349-6272-45f9-a57e-962d6dab8493'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:29.430020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:29.430860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:29.431153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:29.431429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:29.432271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:29.434355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:29.451079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 861/1729] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:29.451079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:29.453316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:29.464255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] The token cache is being invalidate because project 361ea7f0675b4d0f9813bf4eed0e31e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:29.464624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:29.466755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:29.471486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 869/1730] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:28 2022] DELETE /identity/v3/projects/361ea7f0675b4d0f9813bf4eed0e31e2 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:29.471486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:29.475325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:29.598363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ed79a-2cea-4d3a-bbb3-9d732f926e68 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:29.614742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702123cc-6d0e-41f9-82aa-568ce0e1c01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:29.614742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702123cc-6d0e-41f9-82aa-568ce0e1c01a service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:29.614742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702123cc-6d0e-41f9-82aa-568ce0e1c01a service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:29.614742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702123cc-6d0e-41f9-82aa-568ce0e1c01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:29.618107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-702123cc-6d0e-41f9-82aa-568ce0e1c01a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:29.730548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745c349-6272-45f9-a57e-962d6dab8493 tempest-VolumeQuotaClassesTest-749417921 tempest-VolumeQuotaClassesTest-749417921-project-admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:29.761780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:29.762435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:29.762886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:29.763165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:29.770177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:29.809779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702123cc-6d0e-41f9-82aa-568ce0e1c01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:29.811307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:29.812973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:29.813109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702123cc-6d0e-41f9-82aa-568ce0e1c01a service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:29.843378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 862/1731] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:29.844823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2d07-71e8-4488-b1c5-13d7778fb5f7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:29.848510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 870/1732] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:29.850077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2d07-71e8-4488-b1c5-13d7778fb5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:29.850536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2d07-71e8-4488-b1c5-13d7778fb5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:29.865544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:29.871207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:29.906899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-074e2d07-71e8-4488-b1c5-13d7778fb5f7 None None] MFA Rules not processed for user `567ad9bf5078478a9ef462229bf7f930`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:29.908371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-074e2d07-71e8-4488-b1c5-13d7778fb5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:29.909760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf578c-6055-47cf-81d5-e648c9821eec service placement] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:29.929904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:29.930455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:29.930746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:29.931018 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:29.931830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:29.936450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:29.957448 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 871/1733] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:29.959123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:29.965849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:29.978069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:30.097791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 863/1734] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:30.102763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e2d07-71e8-4488-b1c5-13d7778fb5f7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:30.123849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e2d07-71e8-4488-b1c5-13d7778fb5f7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:30.128760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f5ad5-d869-406b-9734-4492b15a59cb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:30.129892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758a82-2f95-4a54-83e5-207948bc3c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:30.131345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758a82-2f95-4a54-83e5-207948bc3c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:30.131834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758a82-2f95-4a54-83e5-207948bc3c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:30.132402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758a82-2f95-4a54-83e5-207948bc3c67 admin admin] PATH_INFO: `/v3/projects/0310efe7893f4b599e19435bd4471d9f/users/d435ce8f4f4a4d3aab077fa1396ec8ed/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:30.135006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8328e70-8ef8-4a64-b7b1-7bd20fb07a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:30.135758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328e70-8ef8-4a64-b7b1-7bd20fb07a7e service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:30.136197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328e70-8ef8-4a64-b7b1-7bd20fb07a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:30.136607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8328e70-8ef8-4a64-b7b1-7bd20fb07a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:30.138780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f8328e70-8ef8-4a64-b7b1-7bd20fb07a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:30.150946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8328e70-8ef8-4a64-b7b1-7bd20fb07a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:30.151521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758a82-2f95-4a54-83e5-207948bc3c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0310efe7893f4b599e19435bd4471d9f, user_id=d435ce8f4f4a4d3aab077fa1396ec8ed, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:30.152613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8328e70-8ef8-4a64-b7b1-7bd20fb07a7e service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:30.154634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758a82-2f95-4a54-83e5-207948bc3c67 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:30.163689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 872/1735] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:30.237259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 864/1736] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:30 2022] PUT /identity/v3/projects/0310efe7893f4b599e19435bd4471d9f/users/d435ce8f4f4a4d3aab077fa1396ec8ed/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:30.250191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a7365-4a48-493b-878b-7e38d7ba7487 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:30.250633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a7365-4a48-493b-878b-7e38d7ba7487 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:30.251011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a7365-4a48-493b-878b-7e38d7ba7487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:30.327820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8b5a7365-4a48-493b-878b-7e38d7ba7487 None None] MFA Rules not processed for user `d435ce8f4f4a4d3aab077fa1396ec8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:30.327820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8b5a7365-4a48-493b-878b-7e38d7ba7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:30.523389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 873/1737] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:30.527768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758a82-2f95-4a54-83e5-207948bc3c67 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:30.669630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758a82-2f95-4a54-83e5-207948bc3c67 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:30.683538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a7365-4a48-493b-878b-7e38d7ba7487 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:30.685119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8b5a7365-4a48-493b-878b-7e38d7ba7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:30.688171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3c404-c280-4fef-b742-5c4d13dfdd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:30.689111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3c404-c280-4fef-b742-5c4d13dfdd0d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:30.689496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3c404-c280-4fef-b742-5c4d13dfdd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:30.689872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3c404-c280-4fef-b742-5c4d13dfdd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:30.690628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3c404-c280-4fef-b742-5c4d13dfdd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:30.705141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3c404-c280-4fef-b742-5c4d13dfdd0d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:30.721398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a7365-4a48-493b-878b-7e38d7ba7487 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:30.733059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:30.737514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:30.738406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:30.738856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:30.740799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] PATH_INFO: `/v3/users/60b10db939f248caa512b936614b16eb` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:30.743500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b10db939f248caa512b936614b16eb)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:30.748663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:30.864626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 865/1738] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:30 2022] POST /identity/v3/projects => generated 363 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:30.874656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3c404-c280-4fef-b742-5c4d13dfdd0d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:31.034579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b10db939f248caa512b936614b16eb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:31.039220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b10db939f248caa512b936614b16eb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:31.099818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3c404-c280-4fef-b742-5c4d13dfdd0d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:31.142068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:31.142756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:31.143041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:31.143315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:31.144059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:31.144799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b10db939f248caa512b936614b16eb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:31.147669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:31.184037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b10db939f248caa512b936614b16eb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:31.187189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3fa2c32-5e3b-4944-aef4-0d334ab095cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b10db939f248caa512b936614b16eb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:31.254871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 874/1739] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:30 2022] DELETE /identity/v3/users/60b10db939f248caa512b936614b16eb => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:31.256794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b5a5-2c6f-4a16-b463-e260aa6aaa63 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:31.257255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b5a5-2c6f-4a16-b463-e260aa6aaa63 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:31.257521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b5a5-2c6f-4a16-b463-e260aa6aaa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:31.277070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 866/1740] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:30 2022] POST /identity/v3/users => generated 288 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:31.281544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:31.285456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:31.310436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6418b5a5-2c6f-4a16-b463-e260aa6aaa63 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:31.311766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6418b5a5-2c6f-4a16-b463-e260aa6aaa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:31.334144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aea2a-9adf-4174-8a72-53cb6a92ba5d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:31.532939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 875/1741] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:31.532939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2059db-bdd0-4814-9197-0ac375a33e08 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:31.532939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2059db-bdd0-4814-9197-0ac375a33e08 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:31.532939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2059db-bdd0-4814-9197-0ac375a33e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:31.554750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4924c-16d5-44c9-9d17-bd7fba73ea75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:31.555398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4924c-16d5-44c9-9d17-bd7fba73ea75 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:31.555680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4924c-16d5-44c9-9d17-bd7fba73ea75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:31.555960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4924c-16d5-44c9-9d17-bd7fba73ea75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:31.556633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4924c-16d5-44c9-9d17-bd7fba73ea75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:31.558332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4924c-16d5-44c9-9d17-bd7fba73ea75 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:31.576493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-5b2059db-bdd0-4814-9197-0ac375a33e08 None None] MFA Rules not processed for user `457d3a58fbd34c2c8d5e082e58b56134`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:31.577947 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5b2059db-bdd0-4814-9197-0ac375a33e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:31.602508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 867/1742] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:31.603436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4924c-16d5-44c9-9d17-bd7fba73ea75 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:31.640349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4924c-16d5-44c9-9d17-bd7fba73ea75 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:31.650484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:31.651181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:31.651671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:31.651965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] PATH_INFO: `/v3/projects/a58ed074e27d4c33a080e24d1d70e706/users/b37795ea4c404c61acd6f0311797a0f9/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:31.694789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58ed074e27d4c33a080e24d1d70e706, user_id=b37795ea4c404c61acd6f0311797a0f9, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:31.699389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:31.808746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 876/1743] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:31.828666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 868/1744] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:31 2022] PUT /identity/v3/projects/a58ed074e27d4c33a080e24d1d70e706/users/b37795ea4c404c61acd6f0311797a0f9/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:31.832619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:31.835534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2059db-bdd0-4814-9197-0ac375a33e08 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:31.838913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:31.844933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5b2059db-bdd0-4814-9197-0ac375a33e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:31.982764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2059db-bdd0-4814-9197-0ac375a33e08 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:32.021857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:32.181793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e37e3b-46de-42d6-aba1-ccfcd026023e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:32.191010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef50f07-6dcb-4933-ab4b-60b820aadcdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:32.191010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef50f07-6dcb-4933-ab4b-60b820aadcdc service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:32.191010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef50f07-6dcb-4933-ab4b-60b820aadcdc service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:32.191010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef50f07-6dcb-4933-ab4b-60b820aadcdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:32.208116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223298-3b39-4160-af95-9b14aa6ab499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:32.210345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223298-3b39-4160-af95-9b14aa6ab499 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:32.210345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223298-3b39-4160-af95-9b14aa6ab499 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:32.212003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223298-3b39-4160-af95-9b14aa6ab499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:32.275157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef50f07-6dcb-4933-ab4b-60b820aadcdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:32.280550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef50f07-6dcb-4933-ab4b-60b820aadcdc service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:32.301976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:32.316845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 869/1745] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:32.320636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef50f07-6dcb-4933-ab4b-60b820aadcdc service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:32.428782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89223298-3b39-4160-af95-9b14aa6ab499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:32.432457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89223298-3b39-4160-af95-9b14aa6ab499 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:32.456193 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 877/1746] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:32.542676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef50f07-6dcb-4933-ab4b-60b820aadcdc service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:32.561162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d35f60-9d1f-433b-b999-c1ad330371e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:32.564420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d35f60-9d1f-433b-b999-c1ad330371e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:32.566978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d35f60-9d1f-433b-b999-c1ad330371e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:32.567346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d35f60-9d1f-433b-b999-c1ad330371e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:32.570010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d35f60-9d1f-433b-b999-c1ad330371e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:32.571868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d35f60-9d1f-433b-b999-c1ad330371e2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:32.621919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 870/1747] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:32 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:32.627625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223298-3b39-4160-af95-9b14aa6ab499 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:32.641774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223298-3b39-4160-af95-9b14aa6ab499 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:32.656060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:32.657521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:32.657818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:32.658097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] PATH_INFO: `/v3/projects/a58ed074e27d4c33a080e24d1d70e706/users/b37795ea4c404c61acd6f0311797a0f9/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:32.666060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58ed074e27d4c33a080e24d1d70e706, user_id=b37795ea4c404c61acd6f0311797a0f9, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:32.674289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:32.763141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adb5ef-2387-4dad-80f9-9618e1ac6e0f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:32.763338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adb5ef-2387-4dad-80f9-9618e1ac6e0f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:32.763630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adb5ef-2387-4dad-80f9-9618e1ac6e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:32.782038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 878/1748] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:32 2022] PUT /identity/v3/projects/a58ed074e27d4c33a080e24d1d70e706/users/b37795ea4c404c61acd6f0311797a0f9/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:32.808483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:32.853572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d1adb5ef-2387-4dad-80f9-9618e1ac6e0f None None] MFA Rules not processed for user `b37795ea4c404c61acd6f0311797a0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:32.856840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d1adb5ef-2387-4dad-80f9-9618e1ac6e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:33.004190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 871/1749] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:33.067254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:33.069459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:33.344388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c5ae-cdbe-4f8e-85a5-e44a8cfb6a7a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:33.344388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:33.344388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:33.344388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:33.347269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:33.347269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:33.347269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:33.347269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 879/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:33.501403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaac99-2301-427a-88a1-bf616dd5b2bd None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:33.501983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaac99-2301-427a-88a1-bf616dd5b2bd None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:33.502325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaac99-2301-427a-88a1-bf616dd5b2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:33.534784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2abaac99-2301-427a-88a1-bf616dd5b2bd None None] MFA Rules not processed for user `4ac91d9adcf244a6bc7de4a98c565de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:33.536185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2abaac99-2301-427a-88a1-bf616dd5b2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:33.659843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 872/1751] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:33.675103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:33.676902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:33.813583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb70f3-dd0f-4e7c-9642-d90cac017e8f service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:33.836236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:33.836881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:33.837302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:33.837576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:33.851563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:33.853859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:33.869534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 880/1752] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:35.647050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:35.739649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:35.841677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaac99-2301-427a-88a1-bf616dd5b2bd None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:35.870669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaac99-2301-427a-88a1-bf616dd5b2bd None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:35.887990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:35.889223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:35.889514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:35.889851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:35.902376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:36.042625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:36.044110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:36.067777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 873/1753] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:36.229878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:36.231349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:36.438044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494328d-c401-46f4-8201-f549765e4591 service nova] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:36.454269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:36.455150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:36.455592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:36.456023 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] PATH_INFO: `/v3/projects/a9253de186804677badae10214f33e09` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:36.458413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9253de186804677badae10214f33e09)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:36.461170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:36.615814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:36.693482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9253de186804677badae10214f33e09', 'request_id': 'req-4c70c727-f1c3-4461-94d5-da677fdc8bf1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:36.716939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9253de186804677badae10214f33e09', 'request_id': 'req-4c70c727-f1c3-4461-94d5-da677fdc8bf1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:36.730183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9253de186804677badae10214f33e09', 'request_id': 'req-4c70c727-f1c3-4461-94d5-da677fdc8bf1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:36.843512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] The token cache is being invalidate because project a9253de186804677badae10214f33e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:36.843512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:36.843512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4c70c727-f1c3-4461-94d5-da677fdc8bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:36.843512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 881/1754] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:36 2022] DELETE /identity/v3/projects/a9253de186804677badae10214f33e09 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:36.846473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:36.867758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821af5c-41d3-4c79-9e66-72c2bfe309ad service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:37.045895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:37.046734 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:37.047082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:37.047520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] PATH_INFO: `/v3/users/445ff900d5994a3fa114d6347501a295` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:37.057400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=445ff900d5994a3fa114d6347501a295)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:37.062978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:37.345351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e21cd-34e3-4ecb-af2b-cd8cc95fc52a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:37.345632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e21cd-34e3-4ecb-af2b-cd8cc95fc52a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:37.346269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e21cd-34e3-4ecb-af2b-cd8cc95fc52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:37.363826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445ff900d5994a3fa114d6347501a295'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:37.364925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445ff900d5994a3fa114d6347501a295'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:37.413478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a85e21cd-34e3-4ecb-af2b-cd8cc95fc52a None None] MFA Rules not processed for user `8b016f7487c546c1ab2cd0ff815099f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:37.420802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a85e21cd-34e3-4ecb-af2b-cd8cc95fc52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:37.465719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445ff900d5994a3fa114d6347501a295'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:37.466477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445ff900d5994a3fa114d6347501a295'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:37.490094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445ff900d5994a3fa114d6347501a295'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:37.522475 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 874/1755] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:36 2022] DELETE /identity/v3/users/445ff900d5994a3fa114d6347501a295 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:37.558927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 882/1756] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:37.997539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:38.112272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:38.113852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:38.296578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff2386-2ab3-472a-9092-4a71efd55ada admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:38.303285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:38.304200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:38.304686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:38.305153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] PATH_INFO: `/v3/users/454db8580bb846bb94b6438d49fd2c0c` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:38.306539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454db8580bb846bb94b6438d49fd2c0c)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:38.308758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:38.553812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454db8580bb846bb94b6438d49fd2c0c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:38.554803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454db8580bb846bb94b6438d49fd2c0c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:38.653441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454db8580bb846bb94b6438d49fd2c0c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:38.654371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454db8580bb846bb94b6438d49fd2c0c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:38.669618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3eb5-d2ec-478e-98da-5de8b820ec46 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:38.670554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3eb5-d2ec-478e-98da-5de8b820ec46 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:38.670998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3eb5-d2ec-478e-98da-5de8b820ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:38.681237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81140af7-6a0d-4e1f-bade-fa974bc48b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454db8580bb846bb94b6438d49fd2c0c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:38.717120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 875/1757] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:38 2022] DELETE /identity/v3/users/454db8580bb846bb94b6438d49fd2c0c => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:38.720316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749c4c-03eb-42a4-b875-57f1df86d238 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:38.722898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749c4c-03eb-42a4-b875-57f1df86d238 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:38.724721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749c4c-03eb-42a4-b875-57f1df86d238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:38.783081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2b749c4c-03eb-42a4-b875-57f1df86d238 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:38.788791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2b749c4c-03eb-42a4-b875-57f1df86d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:38.924353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e61c3eb5-d2ec-478e-98da-5de8b820ec46 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:38.928495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e61c3eb5-d2ec-478e-98da-5de8b820ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:39.038243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:39.064064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 876/1758] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:39.285238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 883/1759] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:31:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 612 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:39.297986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b749c4c-03eb-42a4-b875-57f1df86d238 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:39.299908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2b749c4c-03eb-42a4-b875-57f1df86d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:39.387149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:39.445708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b749c4c-03eb-42a4-b875-57f1df86d238 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:39.452790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:39.453787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:39.458357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:39.458357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:39.486392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:39.486392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:39.523129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 877/1760] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:39.650382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c3eb5-d2ec-478e-98da-5de8b820ec46 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:39.654115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e61c3eb5-d2ec-478e-98da-5de8b820ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:39.684040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c3eb5-d2ec-478e-98da-5de8b820ec46 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:39.697563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:39.698832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:39.700018 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:39.700522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] PATH_INFO: `/v3/projects/ddbe81acae694e6bbfa267e6991e633b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:39.703191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddbe81acae694e6bbfa267e6991e633b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:39.705871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:39.814324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:39.815856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:39.932970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbe81acae694e6bbfa267e6991e633b', 'request_id': 'req-47a99c73-0719-4c00-934d-efe320768abb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:39.941855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbe81acae694e6bbfa267e6991e633b', 'request_id': 'req-47a99c73-0719-4c00-934d-efe320768abb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:39.952595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbe81acae694e6bbfa267e6991e633b', 'request_id': 'req-47a99c73-0719-4c00-934d-efe320768abb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:39.976620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba6f32-d608-496d-a695-bc1a21461330 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:40.026073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] The token cache is being invalidate because project ddbe81acae694e6bbfa267e6991e633b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:40.026388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:40.027104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-47a99c73-0719-4c00-934d-efe320768abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:40.029400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 884/1761] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:39 2022] DELETE /identity/v3/projects/ddbe81acae694e6bbfa267e6991e633b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:40.035462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569a448-4d83-4f5d-a48a-04e43f8bc9ec None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:40.035757 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569a448-4d83-4f5d-a48a-04e43f8bc9ec None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:40.036041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569a448-4d83-4f5d-a48a-04e43f8bc9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:40.075891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1491b9d-0309-4ef7-b5ff-001736ce468a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:40.078638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1491b9d-0309-4ef7-b5ff-001736ce468a service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:40.079570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1491b9d-0309-4ef7-b5ff-001736ce468a service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:40.079663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1491b9d-0309-4ef7-b5ff-001736ce468a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:40.082390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f1491b9d-0309-4ef7-b5ff-001736ce468a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:40.144190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4569a448-4d83-4f5d-a48a-04e43f8bc9ec None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:40.146587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4569a448-4d83-4f5d-a48a-04e43f8bc9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:40.164744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1491b9d-0309-4ef7-b5ff-001736ce468a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:40.167110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1491b9d-0309-4ef7-b5ff-001736ce468a service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:40.191249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 878/1762] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 12:31:40.361925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 885/1763] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:40.369292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dcb6c-5bdb-4c76-b856-6ef951b65584 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:40.369589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dcb6c-5bdb-4c76-b856-6ef951b65584 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:40.369869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dcb6c-5bdb-4c76-b856-6ef951b65584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:40.455939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b35dcb6c-5bdb-4c76-b856-6ef951b65584 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:40.467270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b35dcb6c-5bdb-4c76-b856-6ef951b65584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:40.548902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 879/1764] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:40.553859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569a448-4d83-4f5d-a48a-04e43f8bc9ec None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:40.569295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569a448-4d83-4f5d-a48a-04e43f8bc9ec None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:40.581766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:40.582413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:40.582701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:40.582974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:40.584411 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:40.589310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:40.589310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:40.639967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 886/1765] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:40.641263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dcb6c-5bdb-4c76-b856-6ef951b65584 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:40.656874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dcb6c-5bdb-4c76-b856-6ef951b65584 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:40.680639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df64ea-210f-4f9a-9f19-8eea7949329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:40.682248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df64ea-210f-4f9a-9f19-8eea7949329f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:40.683662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df64ea-210f-4f9a-9f19-8eea7949329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:40.685709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df64ea-210f-4f9a-9f19-8eea7949329f admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:40.688773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df64ea-210f-4f9a-9f19-8eea7949329f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:40.711513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df64ea-210f-4f9a-9f19-8eea7949329f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:40.918870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 880/1766] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:40 2022] POST /identity/v3/projects => generated 393 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:40.920231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:40.939393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0903c93-6665-4e7a-bb2d-a1407cab2a39 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:41.084567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad450f-398f-47c2-a49b-60bf63e65626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:41.085654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad450f-398f-47c2-a49b-60bf63e65626 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:41.086186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad450f-398f-47c2-a49b-60bf63e65626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:41.087062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad450f-398f-47c2-a49b-60bf63e65626 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:41.088560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad450f-398f-47c2-a49b-60bf63e65626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:41.091712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad450f-398f-47c2-a49b-60bf63e65626 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:41.229995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df64ea-210f-4f9a-9f19-8eea7949329f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:41.242999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 887/1767] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:40 2022] POST /identity/v3/users => generated 297 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:41.250411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df64ea-210f-4f9a-9f19-8eea7949329f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:41.272355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152f75d-35fc-461c-b5d5-7b02aa1d4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:41.274122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f75d-35fc-461c-b5d5-7b02aa1d4d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:41.274427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f75d-35fc-461c-b5d5-7b02aa1d4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:41.274767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f75d-35fc-461c-b5d5-7b02aa1d4d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:41.284308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152f75d-35fc-461c-b5d5-7b02aa1d4d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:41.288503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:41.291776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152f75d-35fc-461c-b5d5-7b02aa1d4d4c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:41.329827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad450f-398f-47c2-a49b-60bf63e65626 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:41.340700 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 881/1768] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:41.345833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad450f-398f-47c2-a49b-60bf63e65626 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:41.360910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb5ead-01c8-4c73-8025-7f81564a977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:41.361687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5ead-01c8-4c73-8025-7f81564a977f admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:41.362008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5ead-01c8-4c73-8025-7f81564a977f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:41.362286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5ead-01c8-4c73-8025-7f81564a977f admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:41.364381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb5ead-01c8-4c73-8025-7f81564a977f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:41.366686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb5ead-01c8-4c73-8025-7f81564a977f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:41.418233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152f75d-35fc-461c-b5d5-7b02aa1d4d4c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:41.432365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 888/1769] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:41.439828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152f75d-35fc-461c-b5d5-7b02aa1d4d4c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:41.475073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9945c-12b1-485b-8850-a5411a203384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:41.475832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9945c-12b1-485b-8850-a5411a203384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:41.476764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9945c-12b1-485b-8850-a5411a203384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:41.477087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9945c-12b1-485b-8850-a5411a203384 admin admin] PATH_INFO: `/v3/projects/471973833d264bc095851bc0ac223821/users/686e2044fb214021b40d8f26c475591e/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:41.570328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9945c-12b1-485b-8850-a5411a203384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471973833d264bc095851bc0ac223821, user_id=686e2044fb214021b40d8f26c475591e, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:41.576174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9945c-12b1-485b-8850-a5411a203384 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:41.625084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:41.685292 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3cbc-1d5e-4d9c-97a9-ccf149beb3a2 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:41.685578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3cbc-1d5e-4d9c-97a9-ccf149beb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:41.685862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c3cbc-1d5e-4d9c-97a9-ccf149beb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:41.693494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 882/1770] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:41 2022] PUT /identity/v3/projects/471973833d264bc095851bc0ac223821/users/686e2044fb214021b40d8f26c475591e/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:41.781168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-289c3cbc-1d5e-4d9c-97a9-ccf149beb3a2 None None] MFA Rules not processed for user `686e2044fb214021b40d8f26c475591e`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:41.782475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-289c3cbc-1d5e-4d9c-97a9-ccf149beb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:41.990746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 889/1771] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:41.993596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9945c-12b1-485b-8850-a5411a203384 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:42.250113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9945c-12b1-485b-8850-a5411a203384 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:42.267418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866876d-3b93-40bc-9188-d8db7501de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:42.268155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866876d-3b93-40bc-9188-d8db7501de07 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:42.268445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866876d-3b93-40bc-9188-d8db7501de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:42.268728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866876d-3b93-40bc-9188-d8db7501de07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:42.271130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866876d-3b93-40bc-9188-d8db7501de07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:42.273128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866876d-3b93-40bc-9188-d8db7501de07 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:42.434498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 883/1772] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:41 2022] POST /identity/v3/projects => generated 393 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:42.438253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c3cbc-1d5e-4d9c-97a9-ccf149beb3a2 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:42.455188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c3cbc-1d5e-4d9c-97a9-ccf149beb3a2 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:42.596307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e20c-cf6d-4529-9187-7ec85db73565 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:42.596720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e20c-cf6d-4529-9187-7ec85db73565 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:42.597098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e20c-cf6d-4529-9187-7ec85db73565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:42.689109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cb88e20c-cf6d-4529-9187-7ec85db73565 None None] MFA Rules not processed for user `fa7ce8d93f864130a3c079b1aec6b678`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:42.695488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cb88e20c-cf6d-4529-9187-7ec85db73565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:42.766126 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e07255-6ca0-4708-8d86-0298b09cf15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:42.768611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07255-6ca0-4708-8d86-0298b09cf15e admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:42.768611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07255-6ca0-4708-8d86-0298b09cf15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:42.768611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07255-6ca0-4708-8d86-0298b09cf15e admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:42.768611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e07255-6ca0-4708-8d86-0298b09cf15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:42.770866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e07255-6ca0-4708-8d86-0298b09cf15e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:42.839698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 884/1773] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Sep 5 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:42.895314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 890/1774] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:42 2022] POST /identity/v3/users => generated 303 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:42.899992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88e20c-cf6d-4529-9187-7ec85db73565 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:42.925150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88e20c-cf6d-4529-9187-7ec85db73565 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:42.946550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9edb18-04ce-4eb8-b5ed-f37ddd0b011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:42.947933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9edb18-04ce-4eb8-b5ed-f37ddd0b011d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:42.948737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9edb18-04ce-4eb8-b5ed-f37ddd0b011d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:42.949392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9edb18-04ce-4eb8-b5ed-f37ddd0b011d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:42.951614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9edb18-04ce-4eb8-b5ed-f37ddd0b011d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:42.958354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9edb18-04ce-4eb8-b5ed-f37ddd0b011d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:42.982250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 885/1775] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:42.986770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e07255-6ca0-4708-8d86-0298b09cf15e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:43.026228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e07255-6ca0-4708-8d86-0298b09cf15e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:43.056871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaddc5-2e82-47ed-bb30-4de77d392bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:43.064138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaddc5-2e82-47ed-bb30-4de77d392bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:43.064138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaddc5-2e82-47ed-bb30-4de77d392bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:43.064138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaddc5-2e82-47ed-bb30-4de77d392bd3 admin admin] PATH_INFO: `/v3/projects/9924e701da9f45cd9ac385fd688cc210/users/7949cc1297914527bd6245f5594bffa2/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:43.112877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaddc5-2e82-47ed-bb30-4de77d392bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9924e701da9f45cd9ac385fd688cc210, user_id=7949cc1297914527bd6245f5594bffa2, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:43.112877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaddc5-2e82-47ed-bb30-4de77d392bd3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:43.269537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 891/1776] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:42 2022] PUT /identity/v3/projects/9924e701da9f45cd9ac385fd688cc210/users/7949cc1297914527bd6245f5594bffa2/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:43.273462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9edb18-04ce-4eb8-b5ed-f37ddd0b011d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:43.287010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9edb18-04ce-4eb8-b5ed-f37ddd0b011d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:43.431357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:43.432504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:43.433092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:43.435202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:43.435979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:43.440418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:43.480420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 886/1777] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:43.484004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaddc5-2e82-47ed-bb30-4de77d392bd3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:43.495946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:43.498263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:43.498563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaddc5-2e82-47ed-bb30-4de77d392bd3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:43.532015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:43.537086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:43.537086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:43.537086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] PATH_INFO: `/v3/projects/9924e701da9f45cd9ac385fd688cc210/users/7949cc1297914527bd6245f5594bffa2/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:43.544500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9924e701da9f45cd9ac385fd688cc210, user_id=7949cc1297914527bd6245f5594bffa2, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:43.555005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:43.607829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 892/1778] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:43 2022] PUT /identity/v3/projects/9924e701da9f45cd9ac385fd688cc210/users/7949cc1297914527bd6245f5594bffa2/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:43.622215 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:43.626796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:43.689084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc0d18-9ec6-4e31-bfd6-a15f0a41c8ff admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:43.911289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fbd67-48dd-4f47-a2a8-b52b319bbc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:43.915268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fbd67-48dd-4f47-a2a8-b52b319bbc55 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:43.915268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fbd67-48dd-4f47-a2a8-b52b319bbc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:43.915466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fbd67-48dd-4f47-a2a8-b52b319bbc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:43.923482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de01bd-869e-44ea-bfa9-3c3117b6512e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:43.938847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fbd67-48dd-4f47-a2a8-b52b319bbc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:43.940014 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:43.941963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:43.942173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fbd67-48dd-4f47-a2a8-b52b319bbc55 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:43.942651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:43.945744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] PATH_INFO: `/v3/projects/c1a41de7ab73431a92f34729a7cfad1a` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:43.948054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a41de7ab73431a92f34729a7cfad1a)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:43.950414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:43.961301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 887/1779] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:43.964992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870e15-64d2-41e8-a1a0-6b49c2f1672e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:43.965424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870e15-64d2-41e8-a1a0-6b49c2f1672e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:43.965800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00870e15-64d2-41e8-a1a0-6b49c2f1672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:44.081345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-00870e15-64d2-41e8-a1a0-6b49c2f1672e None None] MFA Rules not processed for user `7949cc1297914527bd6245f5594bffa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:44.089563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-00870e15-64d2-41e8-a1a0-6b49c2f1672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:44.217133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a41de7ab73431a92f34729a7cfad1a', 'request_id': 'req-8acee20b-5769-4c8a-8716-632c57a7aeaa'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:44.236851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a41de7ab73431a92f34729a7cfad1a', 'request_id': 'req-8acee20b-5769-4c8a-8716-632c57a7aeaa'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:44.256291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a41de7ab73431a92f34729a7cfad1a', 'request_id': 'req-8acee20b-5769-4c8a-8716-632c57a7aeaa'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:44.309760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 888/1780] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:44.310455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d82eb-02cd-476d-b697-abed03136d8c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:44.321162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d82eb-02cd-476d-b697-abed03136d8c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:44.321566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d82eb-02cd-476d-b697-abed03136d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:44.346946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] The token cache is being invalidate because project c1a41de7ab73431a92f34729a7cfad1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:44.348276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:44.351121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-8acee20b-5769-4c8a-8716-632c57a7aeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:44.354725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 893/1781] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:43 2022] DELETE /identity/v3/projects/c1a41de7ab73431a92f34729a7cfad1a => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:44.355888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-bf3d82eb-02cd-476d-b697-abed03136d8c None None] MFA Rules not processed for user `457d3a58fbd34c2c8d5e082e58b56134`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:44.358955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce94e-81a4-4b20-8611-d971d9f67d9b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:44.360847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce94e-81a4-4b20-8611-d971d9f67d9b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:44.361378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebce94e-81a4-4b20-8611-d971d9f67d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:44.370007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bf3d82eb-02cd-476d-b697-abed03136d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:44.404387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1ebce94e-81a4-4b20-8611-d971d9f67d9b None None] MFA Rules not processed for user `4ac91d9adcf244a6bc7de4a98c565de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:44.411664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1ebce94e-81a4-4b20-8611-d971d9f67d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:44.490976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:44.553491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 894/1782] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:44.554707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebce94e-81a4-4b20-8611-d971d9f67d9b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:44.556370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1ebce94e-81a4-4b20-8611-d971d9f67d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:44.561882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:44.591828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 889/1783] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:44.593627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d82eb-02cd-476d-b697-abed03136d8c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:44.601556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bf3d82eb-02cd-476d-b697-abed03136d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:44.701919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d82eb-02cd-476d-b697-abed03136d8c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:44.718717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:44.719830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:44.722611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:44.722962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] PATH_INFO: `/v3/users/062fa6ec3b994902bc8c20e137232c4e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:44.724381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebce94e-81a4-4b20-8611-d971d9f67d9b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:44.727252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062fa6ec3b994902bc8c20e137232c4e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:44.729533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:44.737941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:44.738633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:44.738941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:44.739221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:44.744105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:44.967538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:44.987726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:44.998141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062fa6ec3b994902bc8c20e137232c4e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:44.999275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062fa6ec3b994902bc8c20e137232c4e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:45.029290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 895/1784] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:45.126981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062fa6ec3b994902bc8c20e137232c4e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:45.127854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062fa6ec3b994902bc8c20e137232c4e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:45.143187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:45.154780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa3820-61d9-4529-9dea-89685465cfd1 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:45.168288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062fa6ec3b994902bc8c20e137232c4e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:45.174498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd7d89-8660-4b6a-952f-504ed7f01224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:45.184760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7d89-8660-4b6a-952f-504ed7f01224 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:45.184760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7d89-8660-4b6a-952f-504ed7f01224 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:45.184760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd7d89-8660-4b6a-952f-504ed7f01224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:45.184760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f3bd7d89-8660-4b6a-952f-504ed7f01224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:45.251454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 890/1785] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:44 2022] DELETE /identity/v3/users/062fa6ec3b994902bc8c20e137232c4e => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:45.313650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:45.475334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7d89-8660-4b6a-952f-504ed7f01224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:45.476929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd7d89-8660-4b6a-952f-504ed7f01224 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:45.490518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 896/1786] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:46.053890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:46.630906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:46.634151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:46.806050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef2a08-7e05-4628-b72d-36651ed5e353 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:46.812785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:46.813740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:46.814016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:46.814366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] PATH_INFO: `/v3/projects/73df88b92ebf44c1a2a787613e37b889` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:46.815861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73df88b92ebf44c1a2a787613e37b889)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:46.819075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:47.046379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73df88b92ebf44c1a2a787613e37b889', 'request_id': 'req-d029bbbe-2b07-47d0-a088-54a432a89089'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:47.072339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73df88b92ebf44c1a2a787613e37b889', 'request_id': 'req-d029bbbe-2b07-47d0-a088-54a432a89089'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:47.093456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73df88b92ebf44c1a2a787613e37b889', 'request_id': 'req-d029bbbe-2b07-47d0-a088-54a432a89089'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:47.110448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:47.125054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d263-fa39-4af4-b535-945e4e712de4 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:47.126318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d263-fa39-4af4-b535-945e4e712de4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:47.126900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d263-fa39-4af4-b535-945e4e712de4 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:47.129076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 897/1787] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:31:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:31:47.173079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141213a0-7e7a-4335-93bc-841886a44cf2 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:47.173466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141213a0-7e7a-4335-93bc-841886a44cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:47.173844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141213a0-7e7a-4335-93bc-841886a44cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:47.203134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-141213a0-7e7a-4335-93bc-841886a44cf2 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:47.204563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-141213a0-7e7a-4335-93bc-841886a44cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:47.238774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] The token cache is being invalidate because project 73df88b92ebf44c1a2a787613e37b889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:47.239478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:47.248141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d029bbbe-2b07-47d0-a088-54a432a89089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:47.254663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 891/1788] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:46 2022] DELETE /identity/v3/projects/73df88b92ebf44c1a2a787613e37b889 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:47.261939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2860af-b911-4b6f-bdbb-4b2833d90805 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:47.262574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2860af-b911-4b6f-bdbb-4b2833d90805 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:47.263168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2860af-b911-4b6f-bdbb-4b2833d90805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:47.356232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-db2860af-b911-4b6f-bdbb-4b2833d90805 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:47.361090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-db2860af-b911-4b6f-bdbb-4b2833d90805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:47.475751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 898/1789] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:31:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:31:47.539604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 892/1790] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:47.541174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15ee43-43b9-40a6-853e-734a971c053c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:47.541416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15ee43-43b9-40a6-853e-734a971c053c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:47.541741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15ee43-43b9-40a6-853e-734a971c053c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:47.616962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6d15ee43-43b9-40a6-853e-734a971c053c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:47.619206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6d15ee43-43b9-40a6-853e-734a971c053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:47.649651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 899/1791] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:47.652599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2860af-b911-4b6f-bdbb-4b2833d90805 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:47.681782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2860af-b911-4b6f-bdbb-4b2833d90805 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:47.698455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:47.699105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:47.700410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:47.700410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:47.709912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:47.710235 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:47.711928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:47.753089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 893/1792] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:31:47.759795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15ee43-43b9-40a6-853e-734a971c053c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:47.770730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15ee43-43b9-40a6-853e-734a971c053c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:47.810399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:47.811034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:47.816465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:47.817625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:47.821206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:47.831693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:47.978529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:47.986739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 900/1793] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:47 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:47.994347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:47.996396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2854a-66f9-4817-a9b2-9ced8cdc183d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:47.997800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:48.203002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34739e89-3b74-473d-afec-fcf48f973740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:48.203734 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739e89-3b74-473d-afec-fcf48f973740 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:48.203926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739e89-3b74-473d-afec-fcf48f973740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:48.204279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838632ff-69cc-490c-b5ce-e5b46fb10ba3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:48.209449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739e89-3b74-473d-afec-fcf48f973740 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:48.213379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34739e89-3b74-473d-afec-fcf48f973740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:48.217649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34739e89-3b74-473d-afec-fcf48f973740 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:48.236364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:48.237073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:48.240759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:48.243227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] PATH_INFO: `/v3/users/d435ce8f4f4a4d3aab077fa1396ec8ed` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:48.248820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d435ce8f4f4a4d3aab077fa1396ec8ed)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:48.254847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:48.322205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:48.366126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 894/1794] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:47 2022] POST /identity/v3/users => generated 289 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:48.367117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34739e89-3b74-473d-afec-fcf48f973740 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:48.389519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34739e89-3b74-473d-afec-fcf48f973740 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:48.413373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24304c45-080a-494f-85b2-d336030c7f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:48.417946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24304c45-080a-494f-85b2-d336030c7f0d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:48.417946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24304c45-080a-494f-85b2-d336030c7f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:48.417946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24304c45-080a-494f-85b2-d336030c7f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:48.417946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24304c45-080a-494f-85b2-d336030c7f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:48.417946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24304c45-080a-494f-85b2-d336030c7f0d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:48.454907 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 895/1795] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:48.457149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24304c45-080a-494f-85b2-d336030c7f0d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:48.481292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24304c45-080a-494f-85b2-d336030c7f0d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:48.501797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bffc44-8522-4dad-bb5c-da3f227c62fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:48.502864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bffc44-8522-4dad-bb5c-da3f227c62fb admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:48.503370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bffc44-8522-4dad-bb5c-da3f227c62fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:48.503858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bffc44-8522-4dad-bb5c-da3f227c62fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:48.505869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bffc44-8522-4dad-bb5c-da3f227c62fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:48.507818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bffc44-8522-4dad-bb5c-da3f227c62fb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:48.525649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 896/1796] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:48.527164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bffc44-8522-4dad-bb5c-da3f227c62fb admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:48.535303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd435ce8f4f4a4d3aab077fa1396ec8ed'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:48.538956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd435ce8f4f4a4d3aab077fa1396ec8ed'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:48.557434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bffc44-8522-4dad-bb5c-da3f227c62fb admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:48.566543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a9340-c7e0-4ffe-929b-876c04c17592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:48.567356 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a9340-c7e0-4ffe-929b-876c04c17592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:48.568319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a9340-c7e0-4ffe-929b-876c04c17592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:48.568726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a9340-c7e0-4ffe-929b-876c04c17592 admin admin] PATH_INFO: `/v3/projects/63ffb72deacc42bda866b6585b0c7f5d/users/914198257ce6430f91dffacee228f0fb/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:48.610827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a9340-c7e0-4ffe-929b-876c04c17592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ffb72deacc42bda866b6585b0c7f5d, user_id=914198257ce6430f91dffacee228f0fb, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:48.617269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a9340-c7e0-4ffe-929b-876c04c17592 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:48.638134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd435ce8f4f4a4d3aab077fa1396ec8ed'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:48.674902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd435ce8f4f4a4d3aab077fa1396ec8ed'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:48.677687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-271be7f7-288f-4b39-8a2b-831fe5df77e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd435ce8f4f4a4d3aab077fa1396ec8ed'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:48.715034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 901/1797] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:47 2022] DELETE /identity/v3/users/d435ce8f4f4a4d3aab077fa1396ec8ed => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:48.719892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ea26-0ae9-4571-9617-a2eaae0e5dbf None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:48.720023 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ea26-0ae9-4571-9617-a2eaae0e5dbf None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:48.720353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ea26-0ae9-4571-9617-a2eaae0e5dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:48.744755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 897/1798] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:48 2022] PUT /identity/v3/projects/63ffb72deacc42bda866b6585b0c7f5d/users/914198257ce6430f91dffacee228f0fb/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:48.751323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:48.757596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e128e-8c0c-4891-a3f6-2ca87b47466f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:48.757952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e128e-8c0c-4891-a3f6-2ca87b47466f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:48.758305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e128e-8c0c-4891-a3f6-2ca87b47466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:48.835058 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4773ea26-0ae9-4571-9617-a2eaae0e5dbf None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:48.838784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4773ea26-0ae9-4571-9617-a2eaae0e5dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:48.881702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-289e128e-8c0c-4891-a3f6-2ca87b47466f None None] MFA Rules not processed for user `914198257ce6430f91dffacee228f0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:48.891065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-289e128e-8c0c-4891-a3f6-2ca87b47466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:49.031817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 902/1799] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:49.034539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ea26-0ae9-4571-9617-a2eaae0e5dbf None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:49.043746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4773ea26-0ae9-4571-9617-a2eaae0e5dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:49.114441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 898/1800] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:31:49.116052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221fda9-b9e6-4749-8b8f-5cbef335faff None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:49.116501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221fda9-b9e6-4749-8b8f-5cbef335faff None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:49.116933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221fda9-b9e6-4749-8b8f-5cbef335faff None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:49.119476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 899/1801] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:31:49.120427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221fda9-b9e6-4749-8b8f-5cbef335faff None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:49.123352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5221fda9-b9e6-4749-8b8f-5cbef335faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:49.264417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ea26-0ae9-4571-9617-a2eaae0e5dbf None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:49.316752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:49.321681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:49.325349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:49.325349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:49.330323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:49.372604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:49.378789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:49.379891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221fda9-b9e6-4749-8b8f-5cbef335faff None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:49.390278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057f152-d0be-45d8-95e7-acc9c7115a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:49.391006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f152-d0be-45d8-95e7-acc9c7115a4a service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:49.391296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f152-d0be-45d8-95e7-acc9c7115a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:49.391562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057f152-d0be-45d8-95e7-acc9c7115a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:49.412757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057f152-d0be-45d8-95e7-acc9c7115a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:49.417344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 903/1802] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:49.417344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:49.417531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057f152-d0be-45d8-95e7-acc9c7115a4a service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:49.426643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:49.444581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 900/1803] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:49.447421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e557e97-9b82-4598-a0f1-d248c20aff91 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:49.447421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e557e97-9b82-4598-a0f1-d248c20aff91 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:49.447421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e557e97-9b82-4598-a0f1-d248c20aff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:49.489450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2e557e97-9b82-4598-a0f1-d248c20aff91 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:49.493117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f718eb5-9d81-4a9a-a2c2-9b2c4a0f8dbf service nova] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:49.494270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2e557e97-9b82-4598-a0f1-d248c20aff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:49.504722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcb026-14f1-4636-943c-c94aea49052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:49.509212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcb026-14f1-4636-943c-c94aea49052d admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:49.509212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcb026-14f1-4636-943c-c94aea49052d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:49.509212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcb026-14f1-4636-943c-c94aea49052d admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:49.509212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcb026-14f1-4636-943c-c94aea49052d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:49.512266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcb026-14f1-4636-943c-c94aea49052d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:49.518280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 901/1804] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:31:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:49.685119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e557e97-9b82-4598-a0f1-d248c20aff91 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:49.693606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 904/1805] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:49 2022] POST /identity/v3/projects => generated 375 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:49.705151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e557e97-9b82-4598-a0f1-d248c20aff91 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:49.758150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:49.938396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b663-9d0f-41db-9027-6bbd56fe3502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:49.939034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b663-9d0f-41db-9027-6bbd56fe3502 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:49.939313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b663-9d0f-41db-9027-6bbd56fe3502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:49.939591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b663-9d0f-41db-9027-6bbd56fe3502 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:49.940254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b663-9d0f-41db-9027-6bbd56fe3502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:49.942261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b663-9d0f-41db-9027-6bbd56fe3502 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:50.093811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 902/1806] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:49 2022] POST /identity/v3/users => generated 288 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:50.103391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcb026-14f1-4636-943c-c94aea49052d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:50.112195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcb026-14f1-4636-943c-c94aea49052d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:50.119813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7713b-e3bb-4db5-8bc7-09269e0b659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:50.120941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7713b-e3bb-4db5-8bc7-09269e0b659f admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:50.121359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7713b-e3bb-4db5-8bc7-09269e0b659f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:50.121822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7713b-e3bb-4db5-8bc7-09269e0b659f admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:50.122846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7713b-e3bb-4db5-8bc7-09269e0b659f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:50.125187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7713b-e3bb-4db5-8bc7-09269e0b659f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:50.149569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 905/1807] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:50.153228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b663-9d0f-41db-9027-6bbd56fe3502 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:50.202000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b663-9d0f-41db-9027-6bbd56fe3502 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:50.218749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb94d7-f879-4e6e-982a-03b31ba817df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:50.219788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb94d7-f879-4e6e-982a-03b31ba817df admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:50.220392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb94d7-f879-4e6e-982a-03b31ba817df admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:50.220869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb94d7-f879-4e6e-982a-03b31ba817df admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:50.221799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb94d7-f879-4e6e-982a-03b31ba817df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:50.223636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb94d7-f879-4e6e-982a-03b31ba817df admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:50.251942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 903/1808] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:50.253640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7713b-e3bb-4db5-8bc7-09269e0b659f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:50.271914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7713b-e3bb-4db5-8bc7-09269e0b659f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:50.300027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18688-8aac-4f3f-838d-3f6983ca80ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:50.302820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18688-8aac-4f3f-838d-3f6983ca80ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:50.303132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18688-8aac-4f3f-838d-3f6983ca80ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:50.303423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18688-8aac-4f3f-838d-3f6983ca80ea admin admin] PATH_INFO: `/v3/projects/c1d4533084564fe9ad3119574eb01758/users/20324c1c248d4c5b82edeb0f5d304017/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:50.337765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18688-8aac-4f3f-838d-3f6983ca80ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d4533084564fe9ad3119574eb01758, user_id=20324c1c248d4c5b82edeb0f5d304017, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:50.351179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb94d7-f879-4e6e-982a-03b31ba817df admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:50.358814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18688-8aac-4f3f-838d-3f6983ca80ea admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:50.450351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 906/1809] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:50 2022] PUT /identity/v3/projects/c1d4533084564fe9ad3119574eb01758/users/20324c1c248d4c5b82edeb0f5d304017/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:50.462533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59069fa0-c6de-4296-9ef4-2f81627ed62a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:50.462823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59069fa0-c6de-4296-9ef4-2f81627ed62a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:50.463113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59069fa0-c6de-4296-9ef4-2f81627ed62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:50.520613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-59069fa0-c6de-4296-9ef4-2f81627ed62a None None] MFA Rules not processed for user `20324c1c248d4c5b82edeb0f5d304017`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:50.525887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-59069fa0-c6de-4296-9ef4-2f81627ed62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:50.544931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb94d7-f879-4e6e-982a-03b31ba817df admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:50.692238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 907/1810] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:50.695984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59069fa0-c6de-4296-9ef4-2f81627ed62a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:50.734549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:50.737665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:50.743347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:50.744170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:50.769744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:50.772343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:50.805783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 904/1811] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:50.806979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:50.812266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:50.860781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:50.922877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59069fa0-c6de-4296-9ef4-2f81627ed62a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:50.938587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc7718-8155-4c97-b06f-899902cdac8a service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:50.944104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad815f-e7cd-44a2-a9d8-eb9efaecb317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:50.945333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:50.947288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:50.947288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:50.947288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] PATH_INFO: `/v3/projects/0310efe7893f4b599e19435bd4471d9f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:50.947514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad815f-e7cd-44a2-a9d8-eb9efaecb317 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:50.947514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad815f-e7cd-44a2-a9d8-eb9efaecb317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:50.947651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad815f-e7cd-44a2-a9d8-eb9efaecb317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:50.948033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0310efe7893f4b599e19435bd4471d9f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:50.950320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad815f-e7cd-44a2-a9d8-eb9efaecb317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:50.951108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:50.953614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad815f-e7cd-44a2-a9d8-eb9efaecb317 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:51.144817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 908/1812] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:50 2022] POST /identity/v3/projects => generated 379 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:51.150562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad815f-e7cd-44a2-a9d8-eb9efaecb317 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:51.152895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0310efe7893f4b599e19435bd4471d9f', 'request_id': 'req-32229892-8ac6-439c-9ba5-e2fd3af57437'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:51.192440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0310efe7893f4b599e19435bd4471d9f', 'request_id': 'req-32229892-8ac6-439c-9ba5-e2fd3af57437'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:51.199206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0310efe7893f4b599e19435bd4471d9f', 'request_id': 'req-32229892-8ac6-439c-9ba5-e2fd3af57437'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:51.226732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad815f-e7cd-44a2-a9d8-eb9efaecb317 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:51.231800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:51.232414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:51.232697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:51.233000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:51.233657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:51.235615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:51.526523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] The token cache is being invalidate because project 0310efe7893f4b599e19435bd4471d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:51.526523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:51.526523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:51.526523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 905/1813] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:50 2022] DELETE /identity/v3/projects/0310efe7893f4b599e19435bd4471d9f => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:51.531761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:51.538637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:51.627948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32229892-8ac6-439c-9ba5-e2fd3af57437 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:51.634712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:51.635560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:51.635743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:51.636037 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] PATH_INFO: `/v3/users/b37795ea4c404c61acd6f0311797a0f9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:51.637441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37795ea4c404c61acd6f0311797a0f9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:51.639664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:51.942971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 909/1814] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:51 2022] POST /identity/v3/users => generated 296 bytes in 793 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:51.948847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:51.955530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:51.976976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22c6f8-28b5-4050-9a3f-40e8a5c5e011 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:51.993563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587771-91a7-4ec8-9f13-af5f8596cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:51.998141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587771-91a7-4ec8-9f13-af5f8596cc91 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:51.999532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587771-91a7-4ec8-9f13-af5f8596cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:52.005142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3587771-91a7-4ec8-9f13-af5f8596cc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:52.006227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3587771-91a7-4ec8-9f13-af5f8596cc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:52.007967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3587771-91a7-4ec8-9f13-af5f8596cc91 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:52.040578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 910/1815] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:31:52.043429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587771-91a7-4ec8-9f13-af5f8596cc91 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:52.055069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3587771-91a7-4ec8-9f13-af5f8596cc91 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:52.060477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:52.061186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:52.061470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:52.061744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] PATH_INFO: `/v3/projects/78c8daae294549e09577e88d31ded827/users/0de7056e574e4fd5a08a89279d15d968/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:52.079005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c8daae294549e09577e88d31ded827, user_id=0de7056e574e4fd5a08a89279d15d968, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:52.081937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:52.120696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37795ea4c404c61acd6f0311797a0f9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:52.122077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37795ea4c404c61acd6f0311797a0f9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:52.177956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 911/1816] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:52 2022] PUT /identity/v3/projects/78c8daae294549e09577e88d31ded827/users/0de7056e574e4fd5a08a89279d15d968/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:31:52.181525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:52.185604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:52.209767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37795ea4c404c61acd6f0311797a0f9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:52.210635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37795ea4c404c61acd6f0311797a0f9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:52.231931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37795ea4c404c61acd6f0311797a0f9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:52.246805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 906/1817] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:51 2022] DELETE /identity/v3/users/b37795ea4c404c61acd6f0311797a0f9 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:52.310555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48114-b653-4bb0-9818-0b94ba362edf admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:52.418019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd5fbd-b911-4355-9799-a463bead7102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:52.419460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5fbd-b911-4355-9799-a463bead7102 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:52.419912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5fbd-b911-4355-9799-a463bead7102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:52.420117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5fbd-b911-4355-9799-a463bead7102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:52.421272 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd5fbd-b911-4355-9799-a463bead7102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:52.430192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd5fbd-b911-4355-9799-a463bead7102 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:52.441851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 912/1818] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:31:52.446553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:52.457510 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0615c-e0af-4496-a215-0074f198439d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:52.463271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:52.464024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:52.464419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:52.464763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] PATH_INFO: `/v3/projects/78c8daae294549e09577e88d31ded827/users/0de7056e574e4fd5a08a89279d15d968/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:52.467048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c8daae294549e09577e88d31ded827, user_id=0de7056e574e4fd5a08a89279d15d968, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:52.474641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:52.488972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 907/1819] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:52 2022] PUT /identity/v3/projects/78c8daae294549e09577e88d31ded827/users/0de7056e574e4fd5a08a89279d15d968/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:52.500654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34717189-6252-4067-b254-436f31c1caaa None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:52.500933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34717189-6252-4067-b254-436f31c1caaa None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:52.501316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34717189-6252-4067-b254-436f31c1caaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:52.542209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-34717189-6252-4067-b254-436f31c1caaa None None] MFA Rules not processed for user `0de7056e574e4fd5a08a89279d15d968`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:52.551873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-34717189-6252-4067-b254-436f31c1caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:52.604637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:52.627887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:52.631618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:52.652800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 913/1820] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:52.660818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34717189-6252-4067-b254-436f31c1caaa None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:52.662470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-34717189-6252-4067-b254-436f31c1caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:52.747871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884a7cd-9fc2-4dfb-b58a-0e53b0ca975a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:52.753217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:52.753960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:52.754297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:52.754643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] PATH_INFO: `/v3/users/686e2044fb214021b40d8f26c475591e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:52.755651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34717189-6252-4067-b254-436f31c1caaa None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:52.756558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686e2044fb214021b40d8f26c475591e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:52.758771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:52.760175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:52.760815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:52.761146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:52.763623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:52.772220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:52.773704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:52.786551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 914/1821] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:52.893903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:52.895635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:52.944616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e666-5b8b-4366-925c-b4e0a7d711f9 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:52.964244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:52.964898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:52.965212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:52.965635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] PATH_INFO: `/v3/projects/a58ed074e27d4c33a080e24d1d70e706` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:52.967366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58ed074e27d4c33a080e24d1d70e706)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:52.969348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:53.060200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686e2044fb214021b40d8f26c475591e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.061162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686e2044fb214021b40d8f26c475591e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.139755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58ed074e27d4c33a080e24d1d70e706', 'request_id': 'req-b9941fce-151a-47b7-9bb5-9ab8f84b7529'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.156000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686e2044fb214021b40d8f26c475591e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.156872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686e2044fb214021b40d8f26c475591e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.159691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58ed074e27d4c33a080e24d1d70e706', 'request_id': 'req-b9941fce-151a-47b7-9bb5-9ab8f84b7529'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.166122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58ed074e27d4c33a080e24d1d70e706', 'request_id': 'req-b9941fce-151a-47b7-9bb5-9ab8f84b7529'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.174008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686e2044fb214021b40d8f26c475591e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.187453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 908/1822] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:52 2022] DELETE /identity/v3/users/686e2044fb214021b40d8f26c475591e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:53.188839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:53.200908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:53.266905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce153eb-276e-45a1-a22d-7d8af5440a04 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:53.275827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] The token cache is being invalidate because project a58ed074e27d4c33a080e24d1d70e706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:53.276141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.277507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b9941fce-151a-47b7-9bb5-9ab8f84b7529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:53.279720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 915/1823] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:52 2022] DELETE /identity/v3/projects/a58ed074e27d4c33a080e24d1d70e706 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:31:53.282973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413903-0a98-4c1e-8c70-6f0d11ee4a33 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:53.282973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413903-0a98-4c1e-8c70-6f0d11ee4a33 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:53.282973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be413903-0a98-4c1e-8c70-6f0d11ee4a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:53.283231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f5992-25fd-482c-bb32-d17780da0b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:53.283231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f5992-25fd-482c-bb32-d17780da0b07 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:53.283231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f5992-25fd-482c-bb32-d17780da0b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:53.284618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f5992-25fd-482c-bb32-d17780da0b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:53.291932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b87f5992-25fd-482c-bb32-d17780da0b07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:53.313250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-be413903-0a98-4c1e-8c70-6f0d11ee4a33 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:53.313250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-be413903-0a98-4c1e-8c70-6f0d11ee4a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:53.369364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f5992-25fd-482c-bb32-d17780da0b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:53.370970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f5992-25fd-482c-bb32-d17780da0b07 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:53.381869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 909/1824] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:53.383416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550b0a-e43a-43a7-8c62-dae6e6014c2e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:53.383590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 916/1825] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:53.383952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550b0a-e43a-43a7-8c62-dae6e6014c2e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:53.384236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00550b0a-e43a-43a7-8c62-dae6e6014c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:53.393490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413903-0a98-4c1e-8c70-6f0d11ee4a33 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:53.395865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-be413903-0a98-4c1e-8c70-6f0d11ee4a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:53.415847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-00550b0a-e43a-43a7-8c62-dae6e6014c2e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:53.417294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-00550b0a-e43a-43a7-8c62-dae6e6014c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:53.438930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 910/1826] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:53.449585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72201820-11dd-4dba-aa68-9ce3a3140360 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:53.449913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72201820-11dd-4dba-aa68-9ce3a3140360 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:53.450153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72201820-11dd-4dba-aa68-9ce3a3140360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:53.464481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:53.497376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be413903-0a98-4c1e-8c70-6f0d11ee4a33 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:53.501461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423b572-f5d8-4f4a-a138-073d9c47a978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:53.502067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b572-f5d8-4f4a-a138-073d9c47a978 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:53.502345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b572-f5d8-4f4a-a138-073d9c47a978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:53.502667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423b572-f5d8-4f4a-a138-073d9c47a978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:53.505517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-72201820-11dd-4dba-aa68-9ce3a3140360 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:53.506639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-72201820-11dd-4dba-aa68-9ce3a3140360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:53.518253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:53.519355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 911/1827] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:53.521545 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423b572-f5d8-4f4a-a138-073d9c47a978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:53.524613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423b572-f5d8-4f4a-a138-073d9c47a978 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:53.524730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72201820-11dd-4dba-aa68-9ce3a3140360 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:53.533360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72201820-11dd-4dba-aa68-9ce3a3140360 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:53.540142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 917/1828] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:53.559042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:53.560301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:53.560724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:53.562433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:53.564624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:53.564966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:53.568909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:53.605121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 912/1829] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:31:53.610174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423b572-f5d8-4f4a-a138-073d9c47a978 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:53.638101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423b572-f5d8-4f4a-a138-073d9c47a978 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:53.651504 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede58795-6471-4723-b112-44b8fc4c0057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:53.653051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede58795-6471-4723-b112-44b8fc4c0057 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:53.653185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede58795-6471-4723-b112-44b8fc4c0057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:53.653637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede58795-6471-4723-b112-44b8fc4c0057 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:53.655982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede58795-6471-4723-b112-44b8fc4c0057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:53.658586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede58795-6471-4723-b112-44b8fc4c0057 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:53.753734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 918/1830] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:53 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:31:53.758121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:53.768874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f82513-47da-4f8e-90d5-e0d2f8e8c893 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:53.869550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14687e5-a839-41b0-beae-69fc2d71531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:53.870135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14687e5-a839-41b0-beae-69fc2d71531f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:53.870419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14687e5-a839-41b0-beae-69fc2d71531f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:53.870823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14687e5-a839-41b0-beae-69fc2d71531f admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:53.871340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14687e5-a839-41b0-beae-69fc2d71531f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:53.873478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14687e5-a839-41b0-beae-69fc2d71531f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:54.045937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 913/1831] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:53 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:54.050123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede58795-6471-4723-b112-44b8fc4c0057 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:54.068097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede58795-6471-4723-b112-44b8fc4c0057 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:54.077558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:54.078189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:54.078445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:54.078713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:54.079364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:54.081164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:54.095571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 919/1832] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:54.097394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14687e5-a839-41b0-beae-69fc2d71531f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:54.108255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14687e5-a839-41b0-beae-69fc2d71531f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:54.114382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb67e-4fd2-413d-a461-f42871892ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:54.114382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb67e-4fd2-413d-a461-f42871892ead admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:54.114915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb67e-4fd2-413d-a461-f42871892ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:54.115350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb67e-4fd2-413d-a461-f42871892ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:54.116250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb67e-4fd2-413d-a461-f42871892ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:54.117918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb67e-4fd2-413d-a461-f42871892ead admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:54.118398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:54.124189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:54.144205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 914/1833] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:54.146919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb67e-4fd2-413d-a461-f42871892ead admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:54.155963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c55ae-03fa-4d13-9229-bd41a50a497b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:54.158874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb67e-4fd2-413d-a461-f42871892ead admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:54.163223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:54.163998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:54.164284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:54.164591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] PATH_INFO: `/v3/projects/471973833d264bc095851bc0ac223821` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:54.166166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=471973833d264bc095851bc0ac223821)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:54.168026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270195b-c0da-499b-bd44-23d5ae436e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:54.168403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:54.169088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270195b-c0da-499b-bd44-23d5ae436e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:54.169525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270195b-c0da-499b-bd44-23d5ae436e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:54.169947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270195b-c0da-499b-bd44-23d5ae436e87 admin admin] PATH_INFO: `/v3/projects/974fcc4dcf1a406abf0c993f93c456a7/users/74b3af4c80014ce9840b9b071177e944/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:54.190444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270195b-c0da-499b-bd44-23d5ae436e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=974fcc4dcf1a406abf0c993f93c456a7, user_id=74b3af4c80014ce9840b9b071177e944, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:54.194379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270195b-c0da-499b-bd44-23d5ae436e87 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:54.297534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 915/1834] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:54 2022] PUT /identity/v3/projects/974fcc4dcf1a406abf0c993f93c456a7/users/74b3af4c80014ce9840b9b071177e944/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:54.307859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07cb51-340c-4cf1-9e51-adda32223c91 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:54.308154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07cb51-340c-4cf1-9e51-adda32223c91 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:54.308439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07cb51-340c-4cf1-9e51-adda32223c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:54.323713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471973833d264bc095851bc0ac223821', 'request_id': 'req-2d002d87-bfd2-4cac-bc72-656f55851e56'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.331482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471973833d264bc095851bc0ac223821', 'request_id': 'req-2d002d87-bfd2-4cac-bc72-656f55851e56'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.341910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471973833d264bc095851bc0ac223821', 'request_id': 'req-2d002d87-bfd2-4cac-bc72-656f55851e56'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.343148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-dc07cb51-340c-4cf1-9e51-adda32223c91 None None] MFA Rules not processed for user `74b3af4c80014ce9840b9b071177e944`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:54.344921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dc07cb51-340c-4cf1-9e51-adda32223c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:54.368370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:54.434362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 916/1835] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:31:54.439922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07cb51-340c-4cf1-9e51-adda32223c91 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:54.482314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] The token cache is being invalidate because project 471973833d264bc095851bc0ac223821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:54.482706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.483384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.487976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 920/1836] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:54 2022] DELETE /identity/v3/projects/471973833d264bc095851bc0ac223821 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:54.489006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:54.491211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:54.508373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:54.521693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07cb51-340c-4cf1-9e51-adda32223c91 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:54.526551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:54.527259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:54.527635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:54.527929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:54.528704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:54.531149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:54.593378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002d87-bfd2-4cac-bc72-656f55851e56 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:54.598225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:54.600546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:54.600546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:54.600546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] PATH_INFO: `/v3/users/7949cc1297914527bd6245f5594bffa2` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:54.600546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7949cc1297914527bd6245f5594bffa2)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:54.602570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:54.692445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 917/1837] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:54 2022] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:54.698180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:54.703233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:54.785011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7949cc1297914527bd6245f5594bffa2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.785732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7949cc1297914527bd6245f5594bffa2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.840217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96a9c6-5f16-49b3-b688-971ccc1555e7 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:54.845332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23400cbd-0af2-4e74-bc29-402d910163ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:54.846536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23400cbd-0af2-4e74-bc29-402d910163ae admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:54.846843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23400cbd-0af2-4e74-bc29-402d910163ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:54.847120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23400cbd-0af2-4e74-bc29-402d910163ae admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:54.847571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7949cc1297914527bd6245f5594bffa2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.847772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23400cbd-0af2-4e74-bc29-402d910163ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:54.850291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23400cbd-0af2-4e74-bc29-402d910163ae admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:54.867054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7949cc1297914527bd6245f5594bffa2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.875976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7949cc1297914527bd6245f5594bffa2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:54.889542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 921/1838] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:54 2022] DELETE /identity/v3/users/7949cc1297914527bd6245f5594bffa2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:54.961393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 918/1839] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:54 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:54.972020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:54.973517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:55.042562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f27f96-3f24-4148-85ed-a942c0796788 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:55.047898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b3e97-9c9c-47dc-9d4b-d8eee5209f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:55.048555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b3e97-9c9c-47dc-9d4b-d8eee5209f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:55.048840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b3e97-9c9c-47dc-9d4b-d8eee5209f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:55.049148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b3e97-9c9c-47dc-9d4b-d8eee5209f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:55.049848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b3e97-9c9c-47dc-9d4b-d8eee5209f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:55.051850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b3e97-9c9c-47dc-9d4b-d8eee5209f39 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:55.063045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 922/1840] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:55.067299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23400cbd-0af2-4e74-bc29-402d910163ae admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:55.077455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23400cbd-0af2-4e74-bc29-402d910163ae admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:55.082046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc1313-b7af-4d09-b715-9159c80bbc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:55.082705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc1313-b7af-4d09-b715-9159c80bbc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:55.084211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc1313-b7af-4d09-b715-9159c80bbc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:55.084211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc1313-b7af-4d09-b715-9159c80bbc2d admin admin] PATH_INFO: `/v3/projects/8d672dcfa39e423ab581ce4f6510086e/users/d9b042c34092446c8d71c03b850db929/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:55.100139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc1313-b7af-4d09-b715-9159c80bbc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d672dcfa39e423ab581ce4f6510086e, user_id=d9b042c34092446c8d71c03b850db929, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:55.102888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc1313-b7af-4d09-b715-9159c80bbc2d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:55.210311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 919/1841] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:55 2022] PUT /identity/v3/projects/8d672dcfa39e423ab581ce4f6510086e/users/d9b042c34092446c8d71c03b850db929/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:55.215752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b3e97-9c9c-47dc-9d4b-d8eee5209f39 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:55.227541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b3e97-9c9c-47dc-9d4b-d8eee5209f39 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:55.331173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cb683-9633-4473-b423-7f7b001cf0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:55.361100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cb683-9633-4473-b423-7f7b001cf0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:55.361100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cb683-9633-4473-b423-7f7b001cf0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:55.361100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cb683-9633-4473-b423-7f7b001cf0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:55.361100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cb683-9633-4473-b423-7f7b001cf0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:55.361100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cb683-9633-4473-b423-7f7b001cf0d7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:55.361100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 923/1842] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:55.366891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc1313-b7af-4d09-b715-9159c80bbc2d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:55.384369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc1313-b7af-4d09-b715-9159c80bbc2d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:55.396482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:55.396482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:55.396482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:55.396482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] PATH_INFO: `/v3/projects/8d672dcfa39e423ab581ce4f6510086e/users/d9b042c34092446c8d71c03b850db929/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:55.396864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d672dcfa39e423ab581ce4f6510086e, user_id=d9b042c34092446c8d71c03b850db929, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:55.397023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:55.410407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 920/1843] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:55 2022] PUT /identity/v3/projects/8d672dcfa39e423ab581ce4f6510086e/users/d9b042c34092446c8d71c03b850db929/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:55.421518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab736e03-62ca-438f-95a8-423235952597 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:55.421938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab736e03-62ca-438f-95a8-423235952597 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:55.424514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab736e03-62ca-438f-95a8-423235952597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:55.463427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:55.465316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:55.499069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ab736e03-62ca-438f-95a8-423235952597 None None] MFA Rules not processed for user `d9b042c34092446c8d71c03b850db929`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:55.500420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ab736e03-62ca-438f-95a8-423235952597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:55.578190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:55.611329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff6f26-0e93-4d2b-b3e5-f4ea34a4e7be admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:55.613982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 924/1844] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:55.618268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:55.618931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:55.619239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:55.619491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] PATH_INFO: `/v3/projects/9924e701da9f45cd9ac385fd688cc210` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:55.620641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9924e701da9f45cd9ac385fd688cc210)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:55.622621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:55.625891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab736e03-62ca-438f-95a8-423235952597 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:55.627279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ab736e03-62ca-438f-95a8-423235952597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:55.687864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab736e03-62ca-438f-95a8-423235952597 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:55.691542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb0817-6e5d-4c87-b20d-cb66da3b58f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:55.692246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb0817-6e5d-4c87-b20d-cb66da3b58f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:55.692432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb0817-6e5d-4c87-b20d-cb66da3b58f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:55.693334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb0817-6e5d-4c87-b20d-cb66da3b58f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:55.703116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb0817-6e5d-4c87-b20d-cb66da3b58f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:55.704596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb0817-6e5d-4c87-b20d-cb66da3b58f3 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:55.714982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 925/1845] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:55.742011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9924e701da9f45cd9ac385fd688cc210', 'request_id': 'req-682ed4a7-0704-4840-936d-ebab442de83a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:55.749580 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9924e701da9f45cd9ac385fd688cc210', 'request_id': 'req-682ed4a7-0704-4840-936d-ebab442de83a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:55.757029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9924e701da9f45cd9ac385fd688cc210', 'request_id': 'req-682ed4a7-0704-4840-936d-ebab442de83a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:55.898646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:56.042464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] The token cache is being invalidate because project 9924e701da9f45cd9ac385fd688cc210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:31:56.042794 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:56.045092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:56.049981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 921/1846] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:55 2022] DELETE /identity/v3/projects/9924e701da9f45cd9ac385fd688cc210 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:56.053549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86f13-d7e5-42ae-843d-4a303dc62baa None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.054932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86f13-d7e5-42ae-843d-4a303dc62baa None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.055907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86f13-d7e5-42ae-843d-4a303dc62baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.084089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1da86f13-d7e5-42ae-843d-4a303dc62baa None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:56.085915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1da86f13-d7e5-42ae-843d-4a303dc62baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:56.087972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:56.091211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:56.258268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ed4a7-0704-4840-936d-ebab442de83a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:56.268629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:56.269832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.270249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.270617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.274408 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:56.290890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 926/1847] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:56.298886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa070-916c-46d5-80a0-07598cf2b655 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.299418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa070-916c-46d5-80a0-07598cf2b655 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.299837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006aa070-916c-46d5-80a0-07598cf2b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.332685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-006aa070-916c-46d5-80a0-07598cf2b655 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:56.334294 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-006aa070-916c-46d5-80a0-07598cf2b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:56.343507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 927/1848] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:56.347837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aa070-916c-46d5-80a0-07598cf2b655 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:56.362430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006aa070-916c-46d5-80a0-07598cf2b655 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:56.368529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:56.368848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:56.369844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.370197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.370331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:56.370592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.371336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:31:56.371752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:56.373724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:56.387183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 922/1849] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:31:56.417664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 928/1850] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:31:56.422282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:56.441817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f54c6-cbb1-44e3-99d6-70fcff89a04a service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:56.454899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d9b1-6431-4ce4-8b70-03b8af9ede71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:56.455541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d9b1-6431-4ce4-8b70-03b8af9ede71 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.455827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d9b1-6431-4ce4-8b70-03b8af9ede71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.456102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d9b1-6431-4ce4-8b70-03b8af9ede71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.456762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d9b1-6431-4ce4-8b70-03b8af9ede71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:56.461085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d9b1-6431-4ce4-8b70-03b8af9ede71 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:56.565984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 923/1851] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:56 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:56.567466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:56.580185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366c453-349e-415a-8958-d31f69e7b090 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:56.698996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7dd8e-835f-4bd8-af24-3930f38a519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:56.700485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7dd8e-835f-4bd8-af24-3930f38a519a admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.700776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7dd8e-835f-4bd8-af24-3930f38a519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.701523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7dd8e-835f-4bd8-af24-3930f38a519a admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.702241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7dd8e-835f-4bd8-af24-3930f38a519a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:56.704616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7dd8e-835f-4bd8-af24-3930f38a519a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:56.830057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 929/1852] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:56 2022] POST /identity/v3/users => generated 292 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:56.834330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d9b1-6431-4ce4-8b70-03b8af9ede71 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:56.845545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d9b1-6431-4ce4-8b70-03b8af9ede71 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:56.854752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7499d9-4ae1-4fc8-ad0e-341249d98f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:56.855380 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7499d9-4ae1-4fc8-ad0e-341249d98f9a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.855662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7499d9-4ae1-4fc8-ad0e-341249d98f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.855995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7499d9-4ae1-4fc8-ad0e-341249d98f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.856662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7499d9-4ae1-4fc8-ad0e-341249d98f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:56.858485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7499d9-4ae1-4fc8-ad0e-341249d98f9a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:56.876225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 924/1853] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:56.877588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7dd8e-835f-4bd8-af24-3930f38a519a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:56.893620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7dd8e-835f-4bd8-af24-3930f38a519a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:56.904879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d13c30-b270-400c-8277-e2aab55ee628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:56.905557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13c30-b270-400c-8277-e2aab55ee628 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.906412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13c30-b270-400c-8277-e2aab55ee628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.906412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13c30-b270-400c-8277-e2aab55ee628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.906743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d13c30-b270-400c-8277-e2aab55ee628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:56.908427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d13c30-b270-400c-8277-e2aab55ee628 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:56.924054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 930/1854] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:56.925439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7499d9-4ae1-4fc8-ad0e-341249d98f9a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:56.942502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7499d9-4ae1-4fc8-ad0e-341249d98f9a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:56.947989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb3bc-de2d-42e1-91d4-a1e5c18a9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:56.949014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb3bc-de2d-42e1-91d4-a1e5c18a9fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:56.949361 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb3bc-de2d-42e1-91d4-a1e5c18a9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:56.949703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3eb3bc-de2d-42e1-91d4-a1e5c18a9fbb admin admin] PATH_INFO: `/v3/projects/c04d2fbb2f6b4f7289fc5147c3540252/users/f5e06e318fb344e9a9bd72a4106f22db/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:56.972227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb3bc-de2d-42e1-91d4-a1e5c18a9fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04d2fbb2f6b4f7289fc5147c3540252, user_id=f5e06e318fb344e9a9bd72a4106f22db, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:56.975515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3eb3bc-de2d-42e1-91d4-a1e5c18a9fbb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:57.054362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 925/1855] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:56 2022] PUT /identity/v3/projects/c04d2fbb2f6b4f7289fc5147c3540252/users/f5e06e318fb344e9a9bd72a4106f22db/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:57.064856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ce41-673f-4641-acd2-0f1568400a39 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:57.065417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ce41-673f-4641-acd2-0f1568400a39 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:57.065417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ce41-673f-4641-acd2-0f1568400a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:57.099723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8ae2ce41-673f-4641-acd2-0f1568400a39 None None] MFA Rules not processed for user `f5e06e318fb344e9a9bd72a4106f22db`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:57.101726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8ae2ce41-673f-4641-acd2-0f1568400a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:57.165341 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 931/1856] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:57.169924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb3bc-de2d-42e1-91d4-a1e5c18a9fbb admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:57.232533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3eb3bc-de2d-42e1-91d4-a1e5c18a9fbb admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:57.237334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06828396-37ab-4fb2-a0b5-8990d10ada7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:57.237942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828396-37ab-4fb2-a0b5-8990d10ada7b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:57.238229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828396-37ab-4fb2-a0b5-8990d10ada7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:57.238508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06828396-37ab-4fb2-a0b5-8990d10ada7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:57.239146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06828396-37ab-4fb2-a0b5-8990d10ada7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:57.241712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06828396-37ab-4fb2-a0b5-8990d10ada7b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:57.345758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 926/1857] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:31:57 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:57.350684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ce41-673f-4641-acd2-0f1568400a39 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:57.362320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ce41-673f-4641-acd2-0f1568400a39 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:57.418943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:57.423177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e9650-b9ae-41f6-a5e6-3534b5b5cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:57.427714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9650-b9ae-41f6-a5e6-3534b5b5cbef admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:57.427714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9650-b9ae-41f6-a5e6-3534b5b5cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:57.427714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e9650-b9ae-41f6-a5e6-3534b5b5cbef admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:57.427714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e9650-b9ae-41f6-a5e6-3534b5b5cbef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:57.428255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e9650-b9ae-41f6-a5e6-3534b5b5cbef admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:57.550504 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 932/1858] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:31:57 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:31:57.552382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06828396-37ab-4fb2-a0b5-8990d10ada7b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:57.564634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06828396-37ab-4fb2-a0b5-8990d10ada7b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:57.569711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316ffa9-45cb-4437-b2b8-b903c6866b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:57.570496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316ffa9-45cb-4437-b2b8-b903c6866b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:57.570786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316ffa9-45cb-4437-b2b8-b903c6866b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:57.571146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316ffa9-45cb-4437-b2b8-b903c6866b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:57.571762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316ffa9-45cb-4437-b2b8-b903c6866b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:57.573418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316ffa9-45cb-4437-b2b8-b903c6866b55 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:57.589064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 927/1859] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:31:57.594601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e9650-b9ae-41f6-a5e6-3534b5b5cbef admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:57.619464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e9650-b9ae-41f6-a5e6-3534b5b5cbef admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:57.632583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65236-efcf-4925-95c4-e4c03df17f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:57.633489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65236-efcf-4925-95c4-e4c03df17f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:57.633614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65236-efcf-4925-95c4-e4c03df17f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:57.633901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65236-efcf-4925-95c4-e4c03df17f76 admin admin] PATH_INFO: `/v3/projects/dcf9da3e96504e7c8303ce713e7fcd3e/users/4b3fca214c8d4a0bab2767486547eeaa/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:57.654480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65236-efcf-4925-95c4-e4c03df17f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf9da3e96504e7c8303ce713e7fcd3e, user_id=4b3fca214c8d4a0bab2767486547eeaa, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:57.657313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f65236-efcf-4925-95c4-e4c03df17f76 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:57.734864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:57.746229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 933/1860] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:57 2022] PUT /identity/v3/projects/dcf9da3e96504e7c8303ce713e7fcd3e/users/4b3fca214c8d4a0bab2767486547eeaa/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:31:57.752503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316ffa9-45cb-4437-b2b8-b903c6866b55 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:57.765177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316ffa9-45cb-4437-b2b8-b903c6866b55 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:57.839478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acef116-cefb-4e56-8792-d2e02913e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:57.840256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acef116-cefb-4e56-8792-d2e02913e95b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:57.840551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acef116-cefb-4e56-8792-d2e02913e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:57.840827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acef116-cefb-4e56-8792-d2e02913e95b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:57.841555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acef116-cefb-4e56-8792-d2e02913e95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:57.843170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acef116-cefb-4e56-8792-d2e02913e95b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:57.856785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 928/1861] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:31:57.861899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65236-efcf-4925-95c4-e4c03df17f76 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:57.884573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65236-efcf-4925-95c4-e4c03df17f76 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:57.890238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:57.890973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:57.891370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:57.891633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] PATH_INFO: `/v3/projects/dcf9da3e96504e7c8303ce713e7fcd3e/users/4b3fca214c8d4a0bab2767486547eeaa/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:57.894130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf9da3e96504e7c8303ce713e7fcd3e, user_id=4b3fca214c8d4a0bab2767486547eeaa, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:57.899139 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:57.911790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 934/1862] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:31:57 2022] PUT /identity/v3/projects/dcf9da3e96504e7c8303ce713e7fcd3e/users/4b3fca214c8d4a0bab2767486547eeaa/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:31:57.924390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df634a4-ab18-42f1-baeb-096eb580ec0b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:57.924755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df634a4-ab18-42f1-baeb-096eb580ec0b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:57.925181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df634a4-ab18-42f1-baeb-096eb580ec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:57.961267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2df634a4-ab18-42f1-baeb-096eb580ec0b None None] MFA Rules not processed for user `4b3fca214c8d4a0bab2767486547eeaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:57.962145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2df634a4-ab18-42f1-baeb-096eb580ec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:58.136422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 929/1863] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:58.242253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:58.242253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:58.304102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df634a4-ab18-42f1-baeb-096eb580ec0b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:58.306237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2df634a4-ab18-42f1-baeb-096eb580ec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:58.324359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdb432-2aed-4a59-9fa9-d534c579e0e5 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:58.342002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95ca76-ba85-4181-a151-4c3e53d02e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:58.342002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95ca76-ba85-4181-a151-4c3e53d02e1f service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:58.342002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95ca76-ba85-4181-a151-4c3e53d02e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:58.342002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95ca76-ba85-4181-a151-4c3e53d02e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:58.360966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95ca76-ba85-4181-a151-4c3e53d02e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:58.366597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a95ca76-ba85-4181-a151-4c3e53d02e1f service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:58.382788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 935/1864] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:58.463439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df634a4-ab18-42f1-baeb-096eb580ec0b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:58.471165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:58.472052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:58.472480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:58.472898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] PATH_INFO: `/v3/users/914198257ce6430f91dffacee228f0fb` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:58.475291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914198257ce6430f91dffacee228f0fb)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:58.477862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:58.577572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95ca76-ba85-4181-a151-4c3e53d02e1f service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:58.588254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95ca76-ba85-4181-a151-4c3e53d02e1f service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:58.593527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395daf5-5580-4016-b77e-5251ae8e6b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:58.594330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395daf5-5580-4016-b77e-5251ae8e6b72 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:58.594708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395daf5-5580-4016-b77e-5251ae8e6b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:58.595158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395daf5-5580-4016-b77e-5251ae8e6b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:58.670525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914198257ce6430f91dffacee228f0fb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:58.671176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914198257ce6430f91dffacee228f0fb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:58.673497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395daf5-5580-4016-b77e-5251ae8e6b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:58.675127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395daf5-5580-4016-b77e-5251ae8e6b72 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:58.685841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 936/1865] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:58.758894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914198257ce6430f91dffacee228f0fb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:58.759691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914198257ce6430f91dffacee228f0fb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:58.773453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914198257ce6430f91dffacee228f0fb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:58.787757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 930/1866] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:58 2022] DELETE /identity/v3/users/914198257ce6430f91dffacee228f0fb => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:58.803292 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6835b-5872-49ae-9774-0cd0eb885599 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:58.803720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6835b-5872-49ae-9774-0cd0eb885599 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:58.804922 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6835b-5872-49ae-9774-0cd0eb885599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:58.835973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a0c6835b-5872-49ae-9774-0cd0eb885599 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:58.837956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a0c6835b-5872-49ae-9774-0cd0eb885599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:58.923912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 937/1867] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:58.938541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:58.940575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:59.073657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f5794-5c2d-485d-a8ca-b8a31156e931 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:59.078241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2449588-8ddf-493f-9b29-ae96bc4eb17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:59.079004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449588-8ddf-493f-9b29-ae96bc4eb17b service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:59.079507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449588-8ddf-493f-9b29-ae96bc4eb17b service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:59.079888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2449588-8ddf-493f-9b29-ae96bc4eb17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:59.091918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2449588-8ddf-493f-9b29-ae96bc4eb17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:59.093705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2449588-8ddf-493f-9b29-ae96bc4eb17b service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:59.106013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 931/1868] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:31:59.403641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6835b-5872-49ae-9774-0cd0eb885599 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:59.405825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a0c6835b-5872-49ae-9774-0cd0eb885599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:59.419286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6835b-5872-49ae-9774-0cd0eb885599 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:59.439916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:59.441492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:59.446598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:59.446598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] PATH_INFO: `/v3/users/f5e06e318fb344e9a9bd72a4106f22db` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:59.447264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e06e318fb344e9a9bd72a4106f22db)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:59.449169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:59.612010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e06e318fb344e9a9bd72a4106f22db'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:59.612845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e06e318fb344e9a9bd72a4106f22db'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:59.665737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:59.671446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e06e318fb344e9a9bd72a4106f22db'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:59.682290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e06e318fb344e9a9bd72a4106f22db'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:59.684165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e06e318fb344e9a9bd72a4106f22db'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:31:59.708006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 938/1869] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:31:59 2022] DELETE /identity/v3/users/f5e06e318fb344e9a9bd72a4106f22db => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:31:59.712845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879016-c674-4827-afa1-761bbffb41d0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:59.713183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879016-c674-4827-afa1-761bbffb41d0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:59.713466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879016-c674-4827-afa1-761bbffb41d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:59.741773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-be879016-c674-4827-afa1-761bbffb41d0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:31:59.743127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-be879016-c674-4827-afa1-761bbffb41d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:59.837484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:31:59.854128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 932/1870] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:31:59.878384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:59.880699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:59.906782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be879016-c674-4827-afa1-761bbffb41d0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:31:59.908667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-be879016-c674-4827-afa1-761bbffb41d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:31:59.926616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be879016-c674-4827-afa1-761bbffb41d0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:59.931129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:59.931901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:59.932373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:59.932654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] PATH_INFO: `/v3/projects/63ffb72deacc42bda866b6585b0c7f5d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:59.934048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ffb72deacc42bda866b6585b0c7f5d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:59.936558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:59.956546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c23258-f938-44c4-8912-ddeaf3c9ee60 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:31:59.960646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05e9c9-e543-46ad-955f-2acc90cd458d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:31:59.961165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e9c9-e543-46ad-955f-2acc90cd458d service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:31:59.961633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e9c9-e543-46ad-955f-2acc90cd458d service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:31:59.961920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05e9c9-e543-46ad-955f-2acc90cd458d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:31:59.980770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05e9c9-e543-46ad-955f-2acc90cd458d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:31:59.982413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05e9c9-e543-46ad-955f-2acc90cd458d service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:31:59.998389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 939/1871] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:00.088501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ffb72deacc42bda866b6585b0c7f5d', 'request_id': 'req-dae81e17-66aa-40db-bd49-960a18f44db9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.095468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ffb72deacc42bda866b6585b0c7f5d', 'request_id': 'req-dae81e17-66aa-40db-bd49-960a18f44db9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.103573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ffb72deacc42bda866b6585b0c7f5d', 'request_id': 'req-dae81e17-66aa-40db-bd49-960a18f44db9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.181992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] The token cache is being invalidate because project 63ffb72deacc42bda866b6585b0c7f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:00.182521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.183434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.185649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 933/1872] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:31:59 2022] DELETE /identity/v3/projects/63ffb72deacc42bda866b6585b0c7f5d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:00.189864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05e9c9-e543-46ad-955f-2acc90cd458d service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:00.207776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05e9c9-e543-46ad-955f-2acc90cd458d service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:00.311032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:00.311717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:00.312008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:00.312274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] PATH_INFO: `/v3/users/20324c1c248d4c5b82edeb0f5d304017` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:00.313521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20324c1c248d4c5b82edeb0f5d304017)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:00.315445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:00.570339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20324c1c248d4c5b82edeb0f5d304017'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.572106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20324c1c248d4c5b82edeb0f5d304017'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.590298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:00.591662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:00.617233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae81e17-66aa-40db-bd49-960a18f44db9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:00.624932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:00.626075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:00.626652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:00.627112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] PATH_INFO: `/v3/users/74b3af4c80014ce9840b9b071177e944` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:00.629214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b3af4c80014ce9840b9b071177e944)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:00.633043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:00.636599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20324c1c248d4c5b82edeb0f5d304017'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.658043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20324c1c248d4c5b82edeb0f5d304017'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.658261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20324c1c248d4c5b82edeb0f5d304017'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.683580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 940/1873] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:00 2022] DELETE /identity/v3/users/20324c1c248d4c5b82edeb0f5d304017 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:00.766374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:00.766374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:00.930589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3154-94d7-4756-849f-2d704dfddc71 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:00.936528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:00.937170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:00.937511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:00.943169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] PATH_INFO: `/v3/projects/c04d2fbb2f6b4f7289fc5147c3540252` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:00.943169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04d2fbb2f6b4f7289fc5147c3540252)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:00.947245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:00.954792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b3af4c80014ce9840b9b071177e944'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:00.956154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b3af4c80014ce9840b9b071177e944'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.064512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b3af4c80014ce9840b9b071177e944'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.065198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b3af4c80014ce9840b9b071177e944'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.086513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-980f0e04-b093-4249-93b3-13556dbc69cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b3af4c80014ce9840b9b071177e944'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.103607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04d2fbb2f6b4f7289fc5147c3540252', 'request_id': 'req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.111755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04d2fbb2f6b4f7289fc5147c3540252', 'request_id': 'req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.117162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 934/1874] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:00 2022] DELETE /identity/v3/users/74b3af4c80014ce9840b9b071177e944 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:01.118378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04d2fbb2f6b4f7289fc5147c3540252', 'request_id': 'req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.121926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b400747-40fd-4564-9134-10ad7ef24213 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:01.122889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b400747-40fd-4564-9134-10ad7ef24213 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:01.124708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b400747-40fd-4564-9134-10ad7ef24213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:01.149800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:01.151981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6b400747-40fd-4564-9134-10ad7ef24213 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:01.152577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6b400747-40fd-4564-9134-10ad7ef24213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:01.220823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] The token cache is being invalidate because project c04d2fbb2f6b4f7289fc5147c3540252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:01.221155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.222409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.224476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 941/1875] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:00 2022] DELETE /identity/v3/projects/c04d2fbb2f6b4f7289fc5147c3540252 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:01.229223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:01.234094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:01.264923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 935/1876] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:01.275910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b400747-40fd-4564-9134-10ad7ef24213 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:01.278001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6b400747-40fd-4564-9134-10ad7ef24213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:01.342785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c33e4-ea79-49ee-8adf-469a1c7cfce0 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:01.348878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:01.350204 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:01.350891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:01.357835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] PATH_INFO: `/v3/users/4b3fca214c8d4a0bab2767486547eeaa` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:01.363052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3fca214c8d4a0bab2767486547eeaa)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:01.365806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:01.366370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b400747-40fd-4564-9134-10ad7ef24213 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:01.372602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:01.374363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:01.374829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:01.375409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:01.389859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:01.393187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:01.407425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 936/1877] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:32:01.526504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:01.529559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:01.546918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4083ee-1f16-4e63-a0ec-56c143e587b7 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:01.553885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:01.554216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:01.554461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:01.554743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] PATH_INFO: `/v3/projects/c1d4533084564fe9ad3119574eb01758` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:01.556660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d4533084564fe9ad3119574eb01758)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:01.558109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:01.678002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3fca214c8d4a0bab2767486547eeaa'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.679460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3fca214c8d4a0bab2767486547eeaa'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.736661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d4533084564fe9ad3119574eb01758', 'request_id': 'req-dd3856d2-b2f0-4959-b59a-a7641df744c9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.749399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d4533084564fe9ad3119574eb01758', 'request_id': 'req-dd3856d2-b2f0-4959-b59a-a7641df744c9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.764552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d4533084564fe9ad3119574eb01758', 'request_id': 'req-dd3856d2-b2f0-4959-b59a-a7641df744c9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.815196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3fca214c8d4a0bab2767486547eeaa'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.840797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3fca214c8d4a0bab2767486547eeaa'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.841991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0039f2b9-40fa-4a18-a77e-1f96a1299c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3fca214c8d4a0bab2767486547eeaa'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.859665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 942/1878] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:01 2022] DELETE /identity/v3/users/4b3fca214c8d4a0bab2767486547eeaa => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:01.964248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955146-9235-403d-952e-3e035bcab4e5 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:01.964648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955146-9235-403d-952e-3e035bcab4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:01.964912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955146-9235-403d-952e-3e035bcab4e5 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:01.967786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 943/1879] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:32:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:32:01.980687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] The token cache is being invalidate because project c1d4533084564fe9ad3119574eb01758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:01.981316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.982212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dd3856d2-b2f0-4959-b59a-a7641df744c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:01.987439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 937/1880] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:01 2022] DELETE /identity/v3/projects/c1d4533084564fe9ad3119574eb01758 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:01.988136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955146-9235-403d-952e-3e035bcab4e5 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:01.989983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e6d0-b3e4-4245-b5bf-4556ca328b4d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:01.990407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e6d0-b3e4-4245-b5bf-4556ca328b4d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:01.990694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911e6d0-b3e4-4245-b5bf-4556ca328b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:01.991246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-15955146-9235-403d-952e-3e035bcab4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:02.017248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7911e6d0-b3e4-4245-b5bf-4556ca328b4d None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:02.018961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7911e6d0-b3e4-4245-b5bf-4556ca328b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:02.087506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955146-9235-403d-952e-3e035bcab4e5 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:02.092983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:02.093599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:02.093977 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:02.094404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] PATH_INFO: `/v3/users/0de7056e574e4fd5a08a89279d15d968` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:02.095821 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de7056e574e4fd5a08a89279d15d968)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:02.097839 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:02.108657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 938/1881] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:32:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:02.132001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e6d0-b3e4-4245-b5bf-4556ca328b4d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:02.134179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7911e6d0-b3e4-4245-b5bf-4556ca328b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:02.169195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911e6d0-b3e4-4245-b5bf-4556ca328b4d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:02.181313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:02.182412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:02.183092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:02.183745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] PATH_INFO: `/v3/projects/974fcc4dcf1a406abf0c993f93c456a7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:02.185501 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=974fcc4dcf1a406abf0c993f93c456a7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:02.190477 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:02.293632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:02.344652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de7056e574e4fd5a08a89279d15d968'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.345524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de7056e574e4fd5a08a89279d15d968'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.346257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974fcc4dcf1a406abf0c993f93c456a7', 'request_id': 'req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.355518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974fcc4dcf1a406abf0c993f93c456a7', 'request_id': 'req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.364250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974fcc4dcf1a406abf0c993f93c456a7', 'request_id': 'req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.441991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de7056e574e4fd5a08a89279d15d968'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.459261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de7056e574e4fd5a08a89279d15d968'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.460286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de7056e574e4fd5a08a89279d15d968'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.478702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 944/1882] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:01 2022] DELETE /identity/v3/users/0de7056e574e4fd5a08a89279d15d968 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:02.479865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:02.481786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:02.534192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] The token cache is being invalidate because project 974fcc4dcf1a406abf0c993f93c456a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:02.534192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.534660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:02.536435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 939/1883] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:02 2022] DELETE /identity/v3/projects/974fcc4dcf1a406abf0c993f93c456a7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:02.540399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:02.542836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:02.650616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5ff9d-2a25-4db4-87d9-c95199902612 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:02.666649 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:02.668500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:02.668987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:02.672668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:02.683185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275d5c-b0c8-4490-b3cd-2ee89d0d63a1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:02.683395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:02.701774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:02.704461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:02.719430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 945/1884] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:02.762713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:02.764645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:02.764645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:02.764645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] PATH_INFO: `/v3/users/d9b042c34092446c8d71c03b850db929` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:02.766155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b042c34092446c8d71c03b850db929)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:02.768252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:03.079543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b042c34092446c8d71c03b850db929'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.085170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b042c34092446c8d71c03b850db929'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.179282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b042c34092446c8d71c03b850db929'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.179943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b042c34092446c8d71c03b850db929'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.194195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b042c34092446c8d71c03b850db929'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.209382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 940/1885] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:02 2022] DELETE /identity/v3/users/d9b042c34092446c8d71c03b850db929 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:03.287784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:03.289332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:03.295036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:03.299471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:03.335974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dedfd4-12bd-4864-a53f-a4bad91ab275 service nova] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:03.506557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc6d8f-0556-49a8-a9f2-a29df10e1912 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:03.519971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:03.521213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:03.522951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:03.523254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] PATH_INFO: `/v3/projects/dcf9da3e96504e7c8303ce713e7fcd3e` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:03.524992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf9da3e96504e7c8303ce713e7fcd3e)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:03.531749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:03.534523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:03.535355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:03.536049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:03.536929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] PATH_INFO: `/v3/projects/78c8daae294549e09577e88d31ded827` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:03.540317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c8daae294549e09577e88d31ded827)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:03.546320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:03.722101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf9da3e96504e7c8303ce713e7fcd3e', 'request_id': 'req-2d1e3699-9b6c-4190-875b-107b84bdfba4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.722702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c8daae294549e09577e88d31ded827', 'request_id': 'req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.731282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c8daae294549e09577e88d31ded827', 'request_id': 'req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.740997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c8daae294549e09577e88d31ded827', 'request_id': 'req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.748257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf9da3e96504e7c8303ce713e7fcd3e', 'request_id': 'req-2d1e3699-9b6c-4190-875b-107b84bdfba4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.756441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf9da3e96504e7c8303ce713e7fcd3e', 'request_id': 'req-2d1e3699-9b6c-4190-875b-107b84bdfba4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.796786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:03.871599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] The token cache is being invalidate because project 78c8daae294549e09577e88d31ded827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:03.872107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.873598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b188e52-f3c4-4e8e-9bea-ec5e98a08496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.876598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 941/1886] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:03 2022] DELETE /identity/v3/projects/78c8daae294549e09577e88d31ded827 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:03.884891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117e28f-24be-4fc7-bcdd-4d94b93561a5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:03.885325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117e28f-24be-4fc7-bcdd-4d94b93561a5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:03.885629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117e28f-24be-4fc7-bcdd-4d94b93561a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:03.913489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9117e28f-24be-4fc7-bcdd-4d94b93561a5 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:03.915835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9117e28f-24be-4fc7-bcdd-4d94b93561a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:03.923761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] The token cache is being invalidate because project dcf9da3e96504e7c8303ce713e7fcd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:03.924116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.924837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2d1e3699-9b6c-4190-875b-107b84bdfba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:03.929848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 946/1887] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:03 2022] DELETE /identity/v3/projects/dcf9da3e96504e7c8303ce713e7fcd3e => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:03.933229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe383487-c277-4eda-9486-52f419bfc678 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:03.933736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe383487-c277-4eda-9486-52f419bfc678 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:03.934256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe383487-c277-4eda-9486-52f419bfc678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:03.968338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-fe383487-c277-4eda-9486-52f419bfc678 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:03.972025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-fe383487-c277-4eda-9486-52f419bfc678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:04.009893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 942/1888] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:04.018142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0761d-ce9d-40bb-9566-35e9bc8df1ae None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.018484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0761d-ce9d-40bb-9566-35e9bc8df1ae None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.018763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0761d-ce9d-40bb-9566-35e9bc8df1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.041323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f4e0761d-ce9d-40bb-9566-35e9bc8df1ae None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:04.042566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f4e0761d-ce9d-40bb-9566-35e9bc8df1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:04.043883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 947/1889] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:04.056591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 943/1890] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:04.058210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0761d-ce9d-40bb-9566-35e9bc8df1ae None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.058765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2ce1-0cd2-4443-86a6-2c0bc970ed43 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.059056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2ce1-0cd2-4443-86a6-2c0bc970ed43 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.059338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2ce1-0cd2-4443-86a6-2c0bc970ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.060249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f4e0761d-ce9d-40bb-9566-35e9bc8df1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:04.073005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0761d-ce9d-40bb-9566-35e9bc8df1ae None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.087224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-848b2ce1-0cd2-4443-86a6-2c0bc970ed43 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:04.088522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-848b2ce1-0cd2-4443-86a6-2c0bc970ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:04.089807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.090466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.090782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.091981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] PATH_INFO: `/v3/projects/8d672dcfa39e423ab581ce4f6510086e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.093476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d672dcfa39e423ab581ce4f6510086e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.095669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.097083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 948/1891] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:04.097937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b2ce1-0cd2-4443-86a6-2c0bc970ed43 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.107730 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b2ce1-0cd2-4443-86a6-2c0bc970ed43 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.112391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.113020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.113305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.113580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.114235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:04.115100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.116692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.128344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 949/1892] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:04.129208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.140755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137a1cb-5a9a-4f24-9f60-2757d1746b4d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.145330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.145943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.146228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.146501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.147130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:04.147431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.149031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.160712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 950/1893] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:04.162043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.171217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d5b00-1b2d-4229-8276-9eaa05ed0a94 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.175866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d908c2e-bff1-4d37-b70c-d8964898862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.176703 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d908c2e-bff1-4d37-b70c-d8964898862a admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.177587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d908c2e-bff1-4d37-b70c-d8964898862a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.177863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d908c2e-bff1-4d37-b70c-d8964898862a admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.178489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d908c2e-bff1-4d37-b70c-d8964898862a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.180355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d908c2e-bff1-4d37-b70c-d8964898862a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.231720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d672dcfa39e423ab581ce4f6510086e', 'request_id': 'req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:04.238386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d672dcfa39e423ab581ce4f6510086e', 'request_id': 'req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:04.244529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d672dcfa39e423ab581ce4f6510086e', 'request_id': 'req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:04.273267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 951/1894] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:04.274236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d908c2e-bff1-4d37-b70c-d8964898862a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.344378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] The token cache is being invalidate because project 8d672dcfa39e423ab581ce4f6510086e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:04.344926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:04.346461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:04.352979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 944/1895] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:04 2022] DELETE /identity/v3/projects/8d672dcfa39e423ab581ce4f6510086e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:04.355040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.356919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d908c2e-bff1-4d37-b70c-d8964898862a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.357588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:04.362124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee7cd-fcf6-459f-82dd-53b74c4cad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.362890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee7cd-fcf6-459f-82dd-53b74c4cad85 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.363268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee7cd-fcf6-459f-82dd-53b74c4cad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.363613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee7cd-fcf6-459f-82dd-53b74c4cad85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.364380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ee7cd-fcf6-459f-82dd-53b74c4cad85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.366902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ee7cd-fcf6-459f-82dd-53b74c4cad85 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.400976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:04.453461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 952/1896] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:04.455581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd6404-5850-4d3a-b2e6-eba8b2f47530 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.456079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd6404-5850-4d3a-b2e6-eba8b2f47530 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.456701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd6404-5850-4d3a-b2e6-eba8b2f47530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.481757 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2dcd6404-5850-4d3a-b2e6-eba8b2f47530 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:04.482619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b741b-9ad1-45dd-b5a8-c91a2168a7a6 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.482995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2dcd6404-5850-4d3a-b2e6-eba8b2f47530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:04.545689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 953/1897] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:04.546679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727354ab-260e-43c4-9602-1f2940167685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.547299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727354ab-260e-43c4-9602-1f2940167685 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.547575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727354ab-260e-43c4-9602-1f2940167685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.547847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727354ab-260e-43c4-9602-1f2940167685 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.548490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727354ab-260e-43c4-9602-1f2940167685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.550519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727354ab-260e-43c4-9602-1f2940167685 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.554405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd6404-5850-4d3a-b2e6-eba8b2f47530 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.555814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2dcd6404-5850-4d3a-b2e6-eba8b2f47530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:04.567989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd6404-5850-4d3a-b2e6-eba8b2f47530 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.573266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6d68-f379-4f6d-86b0-49db0b6de9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.573891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6d68-f379-4f6d-86b0-49db0b6de9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.574171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6d68-f379-4f6d-86b0-49db0b6de9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.574444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece6d68-f379-4f6d-86b0-49db0b6de9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.575085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece6d68-f379-4f6d-86b0-49db0b6de9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.577084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece6d68-f379-4f6d-86b0-49db0b6de9a9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.631133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 945/1898] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:04.632441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d1107-1f5d-4ad4-a436-a30fa3a77d03 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.632766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d1107-1f5d-4ad4-a436-a30fa3a77d03 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.633064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d1107-1f5d-4ad4-a436-a30fa3a77d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.657582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-854d1107-1f5d-4ad4-a436-a30fa3a77d03 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:04.659548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-854d1107-1f5d-4ad4-a436-a30fa3a77d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:04.667654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 946/1899] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:04.671920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d1107-1f5d-4ad4-a436-a30fa3a77d03 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.680720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 954/1900] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:04.681452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6d68-f379-4f6d-86b0-49db0b6de9a9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.682806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d1107-1f5d-4ad4-a436-a30fa3a77d03 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.689345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950093-5784-4233-9adb-e7cc18890c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.690064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950093-5784-4233-9adb-e7cc18890c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.690486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950093-5784-4233-9adb-e7cc18890c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.690952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71950093-5784-4233-9adb-e7cc18890c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.691655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950093-5784-4233-9adb-e7cc18890c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.693857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71950093-5784-4233-9adb-e7cc18890c20 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.705345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 947/1901] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:04.706746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950093-5784-4233-9adb-e7cc18890c20 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.707574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece6d68-f379-4f6d-86b0-49db0b6de9a9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.714821 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.715429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.715724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.715969 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.716642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:04.716972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.718764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.720503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71950093-5784-4233-9adb-e7cc18890c20 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.729429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d778968-7d3f-473d-9034-66cfdcf3cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.730052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778968-7d3f-473d-9034-66cfdcf3cda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.730349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778968-7d3f-473d-9034-66cfdcf3cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.730655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778968-7d3f-473d-9034-66cfdcf3cda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.736793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778968-7d3f-473d-9034-66cfdcf3cda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.736793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d778968-7d3f-473d-9034-66cfdcf3cda3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.737016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 955/1902] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:04.737016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.745137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 948/1903] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:04.748985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee93c4-2c3c-4c7c-b334-c313636c2ac9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.749171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d778968-7d3f-473d-9034-66cfdcf3cda3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.754320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0686f3b-03e3-4d77-949c-4cc5c1e51730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.755745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686f3b-03e3-4d77-949c-4cc5c1e51730 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.756034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686f3b-03e3-4d77-949c-4cc5c1e51730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.756357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686f3b-03e3-4d77-949c-4cc5c1e51730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.757042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0686f3b-03e3-4d77-949c-4cc5c1e51730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.761833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0686f3b-03e3-4d77-949c-4cc5c1e51730 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.763024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d778968-7d3f-473d-9034-66cfdcf3cda3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.767878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e10ca-394e-4ed0-85ab-08d3eb1286ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.768740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e10ca-394e-4ed0-85ab-08d3eb1286ce admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.769107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e10ca-394e-4ed0-85ab-08d3eb1286ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.769465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e10ca-394e-4ed0-85ab-08d3eb1286ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.770163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e10ca-394e-4ed0-85ab-08d3eb1286ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.772880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e10ca-394e-4ed0-85ab-08d3eb1286ce admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.786983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 956/1904] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:04.789473 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0686f3b-03e3-4d77-949c-4cc5c1e51730 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.808123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0686f3b-03e3-4d77-949c-4cc5c1e51730 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.812914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c4385-0c07-4ec2-9af1-839f8cbed29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.813816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c4385-0c07-4ec2-9af1-839f8cbed29f admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.814169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c4385-0c07-4ec2-9af1-839f8cbed29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.814521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c4385-0c07-4ec2-9af1-839f8cbed29f admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.815595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c4385-0c07-4ec2-9af1-839f8cbed29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.818197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c4385-0c07-4ec2-9af1-839f8cbed29f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.852575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 957/1905] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:04.854021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c4385-0c07-4ec2-9af1-839f8cbed29f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.866660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c4385-0c07-4ec2-9af1-839f8cbed29f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:04.873460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603735f-90f1-4fc9-bfc1-e8d770891254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:04.874236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603735f-90f1-4fc9-bfc1-e8d770891254 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.874518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603735f-90f1-4fc9-bfc1-e8d770891254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.874792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603735f-90f1-4fc9-bfc1-e8d770891254 admin admin] PATH_INFO: `/v3/projects/522b4401fdc34c1097f4a79499e0a57b/users/9ca0fac6dcf945989e5da71ac241b188/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:04.892467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603735f-90f1-4fc9-bfc1-e8d770891254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522b4401fdc34c1097f4a79499e0a57b, user_id=9ca0fac6dcf945989e5da71ac241b188, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:04.896997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603735f-90f1-4fc9-bfc1-e8d770891254 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:04.975886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 958/1906] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:04 2022] PUT /identity/v3/projects/522b4401fdc34c1097f4a79499e0a57b/users/9ca0fac6dcf945989e5da71ac241b188/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:04.976868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603735f-90f1-4fc9-bfc1-e8d770891254 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:04.995245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 949/1907] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:04.997406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4f370-5a86-44c2-9622-488e80346aab None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:04.997895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4f370-5a86-44c2-9622-488e80346aab None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:04.998542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4f370-5a86-44c2-9622-488e80346aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.049329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-abb4f370-5a86-44c2-9622-488e80346aab None None] MFA Rules not processed for user `9ca0fac6dcf945989e5da71ac241b188`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:05.049507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-abb4f370-5a86-44c2-9622-488e80346aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:05.060161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:05.104502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603735f-90f1-4fc9-bfc1-e8d770891254 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:05.149121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 950/1908] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:05.150110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4f370-5a86-44c2-9622-488e80346aab None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:05.189092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:05.190905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:05.191245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:05.191576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] PATH_INFO: `/v3/projects/807cfa96a0494e5e96291e5abb20e78c/users/d394176450aa492cbad22991d8c99f67/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.211847 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807cfa96a0494e5e96291e5abb20e78c, user_id=d394176450aa492cbad22991d8c99f67, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:05.215619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:05.283740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 959/1909] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:04 2022] PUT /identity/v3/projects/807cfa96a0494e5e96291e5abb20e78c/users/d394176450aa492cbad22991d8c99f67/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:05.284424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:05.286115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:05.295479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4f370-5a86-44c2-9622-488e80346aab None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:05.400134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7029-fd85-4ab2-9845-80a87d79d0b4 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:05.407084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dfd31-85c0-4f3a-9a86-f0f8cf98b7ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:05.407403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dfd31-85c0-4f3a-9a86-f0f8cf98b7ad service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:05.407688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dfd31-85c0-4f3a-9a86-f0f8cf98b7ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:05.408043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dfd31-85c0-4f3a-9a86-f0f8cf98b7ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.437735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e1984-c186-4829-9eed-bdaaa8869804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:05.438062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1984-c186-4829-9eed-bdaaa8869804 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:05.438344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1984-c186-4829-9eed-bdaaa8869804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:05.438618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e1984-c186-4829-9eed-bdaaa8869804 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.439263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e1984-c186-4829-9eed-bdaaa8869804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:05.441775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e1984-c186-4829-9eed-bdaaa8869804 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:05.516127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dfd31-85c0-4f3a-9a86-f0f8cf98b7ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:05.517990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dfd31-85c0-4f3a-9a86-f0f8cf98b7ad service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:05.523924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 951/1910] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:05 2022] POST /identity/v3/users => generated 294 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:05.525241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62f92-1593-4692-9e34-e9599a3ee5d6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:05.525523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62f92-1593-4692-9e34-e9599a3ee5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:05.525800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62f92-1593-4692-9e34-e9599a3ee5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.533197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 960/1911] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:05.534316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dfd31-85c0-4f3a-9a86-f0f8cf98b7ad service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:05.550462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dfd31-85c0-4f3a-9a86-f0f8cf98b7ad service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:05.555889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd5d30-8b5d-4d0f-9877-137ad6c108a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:05.556513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd5d30-8b5d-4d0f-9877-137ad6c108a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:05.556797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd5d30-8b5d-4d0f-9877-137ad6c108a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:05.557425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd5d30-8b5d-4d0f-9877-137ad6c108a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.558630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd5d30-8b5d-4d0f-9877-137ad6c108a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:05.562453 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd5d30-8b5d-4d0f-9877-137ad6c108a7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:05.580024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 961/1912] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:05.581151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd5d30-8b5d-4d0f-9877-137ad6c108a7 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:05.594460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd5d30-8b5d-4d0f-9877-137ad6c108a7 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:05.602738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:05.604076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:05.604613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:05.605199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] PATH_INFO: `/v3/users/9ca0fac6dcf945989e5da71ac241b188` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.606733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca0fac6dcf945989e5da71ac241b188)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:05.607218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fbd62f92-1593-4692-9e34-e9599a3ee5d6 None None] MFA Rules not processed for user `d394176450aa492cbad22991d8c99f67`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:05.608889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:05.611056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fbd62f92-1593-4692-9e34-e9599a3ee5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:05.718545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 952/1913] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:05.719225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd62f92-1593-4692-9e34-e9599a3ee5d6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:05.734426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd62f92-1593-4692-9e34-e9599a3ee5d6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:05.741682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999788b-b016-4487-8444-358a4fdf63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:05.742432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999788b-b016-4487-8444-358a4fdf63b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:05.742804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999788b-b016-4487-8444-358a4fdf63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:05.743229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999788b-b016-4487-8444-358a4fdf63b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.743938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999788b-b016-4487-8444-358a4fdf63b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:05.745651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999788b-b016-4487-8444-358a4fdf63b1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:05.756983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 953/1914] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:05.757296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999788b-b016-4487-8444-358a4fdf63b1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:05.777258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999788b-b016-4487-8444-358a4fdf63b1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:05.788987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca0fac6dcf945989e5da71ac241b188'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:05.788987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca0fac6dcf945989e5da71ac241b188'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:05.789655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:05.789655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:05.789655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:05.789655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:05.789989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:05.789989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:05.916035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca0fac6dcf945989e5da71ac241b188'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:05.931328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 954/1915] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:05 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:05.931328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:05.931328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:05.937006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca0fac6dcf945989e5da71ac241b188'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:05.937772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca0fac6dcf945989e5da71ac241b188'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:05.955275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 962/1916] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:05 2022] DELETE /identity/v3/users/9ca0fac6dcf945989e5da71ac241b188 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:05.956420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:05.957948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:06.014797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:06.019696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b2b93-8d85-4526-9351-02a25ec88c3c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.045029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee9a59-d9dd-4cfa-9cb6-8393450424e0 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.051908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f97089-381f-4e29-962f-ed656b511495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.052618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97089-381f-4e29-962f-ed656b511495 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.052905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97089-381f-4e29-962f-ed656b511495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.053214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97089-381f-4e29-962f-ed656b511495 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.053873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f97089-381f-4e29-962f-ed656b511495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.057219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f97089-381f-4e29-962f-ed656b511495 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.094755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ea4f8-d5bf-4db7-b465-c7017936d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.095171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ea4f8-d5bf-4db7-b465-c7017936d1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.095505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ea4f8-d5bf-4db7-b465-c7017936d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.095781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ea4f8-d5bf-4db7-b465-c7017936d1f8 admin admin] PATH_INFO: `/v3/projects/fe746b81dd644364ac264998dd26bece/users/f9d07f7cbe35441f9d94db0347c1be71/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.115258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ea4f8-d5bf-4db7-b465-c7017936d1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe746b81dd644364ac264998dd26bece, user_id=f9d07f7cbe35441f9d94db0347c1be71, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.118029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ea4f8-d5bf-4db7-b465-c7017936d1f8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.135289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 963/1917] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:05 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:06.136966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96aec1-d804-4e6f-a029-a68290ff27f7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.137469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96aec1-d804-4e6f-a029-a68290ff27f7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.137919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96aec1-d804-4e6f-a029-a68290ff27f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.163048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-9d96aec1-d804-4e6f-a029-a68290ff27f7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:06.165114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9d96aec1-d804-4e6f-a029-a68290ff27f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:06.178045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 964/1918] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:06.179289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96aec1-d804-4e6f-a029-a68290ff27f7 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.190684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 955/1919] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:05 2022] PUT /identity/v3/projects/fe746b81dd644364ac264998dd26bece/users/f9d07f7cbe35441f9d94db0347c1be71/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:06.191373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96aec1-d804-4e6f-a029-a68290ff27f7 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.203327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1de6a-bff9-423b-ac43-868473d69911 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.204008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1de6a-bff9-423b-ac43-868473d69911 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.204288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1de6a-bff9-423b-ac43-868473d69911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.270498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d7d1de6a-bff9-423b-ac43-868473d69911 None None] MFA Rules not processed for user `f9d07f7cbe35441f9d94db0347c1be71`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:06.272770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d7d1de6a-bff9-423b-ac43-868473d69911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:06.289916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.295834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.295834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.295834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.295834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.295834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.306618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 965/1920] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:06.307587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.312775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:06.384873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:06.408004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b960da9-5e24-437d-94d4-2d5aea1e4070 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.414446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08c4c4-23ac-4e1d-8416-dcb290aaf638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.415220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08c4c4-23ac-4e1d-8416-dcb290aaf638 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.415721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08c4c4-23ac-4e1d-8416-dcb290aaf638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.416105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08c4c4-23ac-4e1d-8416-dcb290aaf638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.432799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08c4c4-23ac-4e1d-8416-dcb290aaf638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.434433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08c4c4-23ac-4e1d-8416-dcb290aaf638 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.434924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 956/1921] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:06.435650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1de6a-bff9-423b-ac43-868473d69911 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.447620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 966/1922] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:06.448510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08c4c4-23ac-4e1d-8416-dcb290aaf638 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.460539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08c4c4-23ac-4e1d-8416-dcb290aaf638 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.462098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1de6a-bff9-423b-ac43-868473d69911 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.468376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7594204-7415-4bce-ae78-6e9e03cdd4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.469117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594204-7415-4bce-ae78-6e9e03cdd4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.469397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594204-7415-4bce-ae78-6e9e03cdd4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.469668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594204-7415-4bce-ae78-6e9e03cdd4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.470487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7594204-7415-4bce-ae78-6e9e03cdd4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.473273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7594204-7415-4bce-ae78-6e9e03cdd4b0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.476522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ddc7-953f-421e-bf1d-9f2d675f4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.477236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ddc7-953f-421e-bf1d-9f2d675f4b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.477526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ddc7-953f-421e-bf1d-9f2d675f4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.479735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10ddc7-953f-421e-bf1d-9f2d675f4b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.480519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10ddc7-953f-421e-bf1d-9f2d675f4b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.486049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10ddc7-953f-421e-bf1d-9f2d675f4b49 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.516301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 957/1923] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:06.520534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ddc7-953f-421e-bf1d-9f2d675f4b49 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.531553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10ddc7-953f-421e-bf1d-9f2d675f4b49 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.536537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f36ce-799f-4f66-ada6-e97b8a3ac6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.537243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f36ce-799f-4f66-ada6-e97b8a3ac6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.537525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f36ce-799f-4f66-ada6-e97b8a3ac6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.537803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f36ce-799f-4f66-ada6-e97b8a3ac6c8 admin admin] PATH_INFO: `/v3/projects/648dd9c86a324d32b48a012e3cbc4dac/users/0683b767ab8a441baddeba858358a584/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.554317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f36ce-799f-4f66-ada6-e97b8a3ac6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=648dd9c86a324d32b48a012e3cbc4dac, user_id=0683b767ab8a441baddeba858358a584, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.557115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f36ce-799f-4f66-ada6-e97b8a3ac6c8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.601645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 967/1924] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:06 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:06.606323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7594204-7415-4bce-ae78-6e9e03cdd4b0 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.656763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:06.666536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 958/1925] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:06 2022] PUT /identity/v3/projects/648dd9c86a324d32b48a012e3cbc4dac/users/0683b767ab8a441baddeba858358a584/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:06.690375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783b0f-26d9-4afe-b56d-c51ad0d2c7de None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.690670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783b0f-26d9-4afe-b56d-c51ad0d2c7de None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.690952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783b0f-26d9-4afe-b56d-c51ad0d2c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.719544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7594204-7415-4bce-ae78-6e9e03cdd4b0 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.722242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e6783b0f-26d9-4afe-b56d-c51ad0d2c7de None None] MFA Rules not processed for user `0683b767ab8a441baddeba858358a584`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:06.723835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e6783b0f-26d9-4afe-b56d-c51ad0d2c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:06.800147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdaef4-9d56-45be-bfb0-105f28b7395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.801655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdaef4-9d56-45be-bfb0-105f28b7395f admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.802640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdaef4-9d56-45be-bfb0-105f28b7395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.803080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdaef4-9d56-45be-bfb0-105f28b7395f admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.803945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdaef4-9d56-45be-bfb0-105f28b7395f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.806600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdaef4-9d56-45be-bfb0-105f28b7395f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.820415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 959/1926] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:06.825789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6783b0f-26d9-4afe-b56d-c51ad0d2c7de None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.853351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6783b0f-26d9-4afe-b56d-c51ad0d2c7de None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.858622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bd3d3-d4d8-420c-8dd6-54b1b16f1b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.859233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bd3d3-d4d8-420c-8dd6-54b1b16f1b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.859664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bd3d3-d4d8-420c-8dd6-54b1b16f1b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.859982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bd3d3-d4d8-420c-8dd6-54b1b16f1b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.860691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bd3d3-d4d8-420c-8dd6-54b1b16f1b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.862776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bd3d3-d4d8-420c-8dd6-54b1b16f1b88 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.909198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 968/1927] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:06 2022] POST /identity/v3/users => generated 300 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:06.911801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdaef4-9d56-45be-bfb0-105f28b7395f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.924411 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdaef4-9d56-45be-bfb0-105f28b7395f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:06.934417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932c799-ea53-4d3a-9154-36bd49014efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:06.935049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c799-ea53-4d3a-9154-36bd49014efb admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:06.935335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c799-ea53-4d3a-9154-36bd49014efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:06.935613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c799-ea53-4d3a-9154-36bd49014efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:06.936275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932c799-ea53-4d3a-9154-36bd49014efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:06.937993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932c799-ea53-4d3a-9154-36bd49014efb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:06.951208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 969/1928] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:06.955405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932c799-ea53-4d3a-9154-36bd49014efb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.960279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 960/1929] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:06 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:06.964288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bd3d3-d4d8-420c-8dd6-54b1b16f1b88 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:06.965974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932c799-ea53-4d3a-9154-36bd49014efb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.029733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.033039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.033039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.033039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] PATH_INFO: `/v3/projects/311c462d8779486b9b264693f2295e58/users/04ab0c322336426ca103ffa76fd49f75/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.050410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bd3d3-d4d8-420c-8dd6-54b1b16f1b88 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.050717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311c462d8779486b9b264693f2295e58, user_id=04ab0c322336426ca103ffa76fd49f75, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.055561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.056758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ddb39-0b0d-4b69-b59d-5af53a635219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.057562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ddb39-0b0d-4b69-b59d-5af53a635219 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.057850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ddb39-0b0d-4b69-b59d-5af53a635219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.062459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ddb39-0b0d-4b69-b59d-5af53a635219 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.062459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ddb39-0b0d-4b69-b59d-5af53a635219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.062459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ddb39-0b0d-4b69-b59d-5af53a635219 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.140173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 970/1930] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:06 2022] PUT /identity/v3/projects/311c462d8779486b9b264693f2295e58/users/04ab0c322336426ca103ffa76fd49f75/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:07.141351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.146611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:07.197895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 961/1931] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:06 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:07.198794 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ddb39-0b0d-4b69-b59d-5af53a635219 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.211258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ddb39-0b0d-4b69-b59d-5af53a635219 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.216467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b378ee-ff10-411b-9563-6ac9f759a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.217120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b378ee-ff10-411b-9563-6ac9f759a268 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.217412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b378ee-ff10-411b-9563-6ac9f759a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.217817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b378ee-ff10-411b-9563-6ac9f759a268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.218522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b378ee-ff10-411b-9563-6ac9f759a268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.219144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257affcd-acd8-4f41-9a67-e4900abb55b9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.220387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b378ee-ff10-411b-9563-6ac9f759a268 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.225709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.226618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.226618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.227016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] PATH_INFO: `/v3/projects/522b4401fdc34c1097f4a79499e0a57b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.228242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] RBAC: Authorizing `identity:delete_project(project_id=522b4401fdc34c1097f4a79499e0a57b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.230174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.235947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 962/1932] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:07.235947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b378ee-ff10-411b-9563-6ac9f759a268 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.247097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b378ee-ff10-411b-9563-6ac9f759a268 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.251983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de700f8a-69f1-443d-943f-39e50d63cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.252626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de700f8a-69f1-443d-943f-39e50d63cc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.253050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de700f8a-69f1-443d-943f-39e50d63cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.253377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de700f8a-69f1-443d-943f-39e50d63cc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.253964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de700f8a-69f1-443d-943f-39e50d63cc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.255668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de700f8a-69f1-443d-943f-39e50d63cc04 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.267329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 963/1933] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:07.269026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de700f8a-69f1-443d-943f-39e50d63cc04 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.280341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de700f8a-69f1-443d-943f-39e50d63cc04 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.285528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c25c-98fd-4eb8-a545-43025de8b2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.286853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c25c-98fd-4eb8-a545-43025de8b2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.287139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c25c-98fd-4eb8-a545-43025de8b2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.287463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c25c-98fd-4eb8-a545-43025de8b2bd admin admin] PATH_INFO: `/v3/projects/311c462d8779486b9b264693f2295e58/users/04ab0c322336426ca103ffa76fd49f75/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.289613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c25c-98fd-4eb8-a545-43025de8b2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=311c462d8779486b9b264693f2295e58, user_id=04ab0c322336426ca103ffa76fd49f75, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.292678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c25c-98fd-4eb8-a545-43025de8b2bd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.303760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 964/1934] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:07 2022] PUT /identity/v3/projects/311c462d8779486b9b264693f2295e58/users/04ab0c322336426ca103ffa76fd49f75/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:07.304602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c25c-98fd-4eb8-a545-43025de8b2bd admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.384086 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c25c-98fd-4eb8-a545-43025de8b2bd admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.388934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57246c-6658-4f96-b905-cc170089223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.389803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57246c-6658-4f96-b905-cc170089223c admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.390083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57246c-6658-4f96-b905-cc170089223c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.390554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57246c-6658-4f96-b905-cc170089223c admin admin] PATH_INFO: `/v3/projects/453ec97905d9415d9f933035777c6d55/users/be97555af6da426189dcb7156a8764a7/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.402917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522b4401fdc34c1097f4a79499e0a57b', 'request_id': 'req-9a19f4d1-70b8-490d-b30c-0fbd4356790b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:07.408974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57246c-6658-4f96-b905-cc170089223c admin admin] RBAC: Authorizing `identity:create_grant(project_id=453ec97905d9415d9f933035777c6d55, user_id=be97555af6da426189dcb7156a8764a7, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.412787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57246c-6658-4f96-b905-cc170089223c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.420728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522b4401fdc34c1097f4a79499e0a57b', 'request_id': 'req-9a19f4d1-70b8-490d-b30c-0fbd4356790b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:07.428765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522b4401fdc34c1097f4a79499e0a57b', 'request_id': 'req-9a19f4d1-70b8-490d-b30c-0fbd4356790b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:07.506415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] The token cache is being invalidate because project 522b4401fdc34c1097f4a79499e0a57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:07.506959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 965/1935] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:07 2022] PUT /identity/v3/projects/453ec97905d9415d9f933035777c6d55/users/be97555af6da426189dcb7156a8764a7/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:07.507454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:07.508423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:07.509409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5eb740-d3f5-4405-a680-ba2e6bf84c6b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.510291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5eb740-d3f5-4405-a680-ba2e6bf84c6b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.510421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 971/1936] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:07 2022] DELETE /identity/v3/projects/522b4401fdc34c1097f4a79499e0a57b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:07.510587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5eb740-d3f5-4405-a680-ba2e6bf84c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.511565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.514390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:07.559109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ec5eb740-d3f5-4405-a680-ba2e6bf84c6b None None] MFA Rules not processed for user `04ab0c322336426ca103ffa76fd49f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:07.563058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ec5eb740-d3f5-4405-a680-ba2e6bf84c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:07.611011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19f4d1-70b8-490d-b30c-0fbd4356790b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.694131 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 966/1937] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:07.695502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3a475-0410-4f7b-b135-0fa63002b614 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.696150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3a475-0410-4f7b-b135-0fa63002b614 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.696455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3a475-0410-4f7b-b135-0fa63002b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.719882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6fd3a475-0410-4f7b-b135-0fa63002b614 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:07.721264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6fd3a475-0410-4f7b-b135-0fa63002b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:07.723274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bcfbb-6adc-44b8-92c9-10fb9c50ce24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.724316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bcfbb-6adc-44b8-92c9-10fb9c50ce24 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.724648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bcfbb-6adc-44b8-92c9-10fb9c50ce24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.725024 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bcfbb-6adc-44b8-92c9-10fb9c50ce24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.725742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bcfbb-6adc-44b8-92c9-10fb9c50ce24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.727457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bcfbb-6adc-44b8-92c9-10fb9c50ce24 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.736995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 967/1938] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:07.736995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3a475-0410-4f7b-b135-0fa63002b614 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.737485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6fd3a475-0410-4f7b-b135-0fa63002b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:07.745357 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 972/1939] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:07.746869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384035-2e6b-47ca-9c31-a00f30fc3d93 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.747455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384035-2e6b-47ca-9c31-a00f30fc3d93 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.747873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384035-2e6b-47ca-9c31-a00f30fc3d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.770207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c6384035-2e6b-47ca-9c31-a00f30fc3d93 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:07.772691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c6384035-2e6b-47ca-9c31-a00f30fc3d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:07.790318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 973/1940] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:07.791211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384035-2e6b-47ca-9c31-a00f30fc3d93 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.805292 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384035-2e6b-47ca-9c31-a00f30fc3d93 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.813647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fde0e-6a91-463f-b6a6-6b8b90c40d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.821966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fde0e-6a91-463f-b6a6-6b8b90c40d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.821966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fde0e-6a91-463f-b6a6-6b8b90c40d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.821966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fde0e-6a91-463f-b6a6-6b8b90c40d6a admin admin] PATH_INFO: `/v3/projects/453ec97905d9415d9f933035777c6d55/users/be97555af6da426189dcb7156a8764a7/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.823698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fde0e-6a91-463f-b6a6-6b8b90c40d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=453ec97905d9415d9f933035777c6d55, user_id=be97555af6da426189dcb7156a8764a7, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.827548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fde0e-6a91-463f-b6a6-6b8b90c40d6a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.838000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3a475-0410-4f7b-b135-0fa63002b614 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.843588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 974/1941] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:07 2022] PUT /identity/v3/projects/453ec97905d9415d9f933035777c6d55/users/be97555af6da426189dcb7156a8764a7/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:07.844623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fde0e-6a91-463f-b6a6-6b8b90c40d6a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:07.901032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545e5d4-5cd6-46ca-ae93-a495e97ac06b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.901963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e5d4-5cd6-46ca-ae93-a495e97ac06b service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.902523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e5d4-5cd6-46ca-ae93-a495e97ac06b service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.903002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545e5d4-5cd6-46ca-ae93-a495e97ac06b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.946606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fde0e-6a91-463f-b6a6-6b8b90c40d6a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:07.960298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf84e48-f2c8-4cd6-82b0-dc4b0b7544be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:07.960936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84e48-f2c8-4cd6-82b0-dc4b0b7544be admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.961255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84e48-f2c8-4cd6-82b0-dc4b0b7544be admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.961520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84e48-f2c8-4cd6-82b0-dc4b0b7544be admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.962195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf84e48-f2c8-4cd6-82b0-dc4b0b7544be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:07.962496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf84e48-f2c8-4cd6-82b0-dc4b0b7544be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.964103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf84e48-f2c8-4cd6-82b0-dc4b0b7544be admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.975049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545e5d4-5cd6-46ca-ae93-a495e97ac06b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:07.979257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 975/1942] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:07.979494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545e5d4-5cd6-46ca-ae93-a495e97ac06b service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:07.979578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4719-90b7-4e83-89c8-d199516346a0 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:07.979578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4719-90b7-4e83-89c8-d199516346a0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:07.979578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4719-90b7-4e83-89c8-d199516346a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:07.986841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 968/1943] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:07.987639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545e5d4-5cd6-46ca-ae93-a495e97ac06b service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.003092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545e5d4-5cd6-46ca-ae93-a495e97ac06b service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.017051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7f1f4719-90b7-4e83-89c8-d199516346a0 None None] MFA Rules not processed for user `be97555af6da426189dcb7156a8764a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:08.017051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7f1f4719-90b7-4e83-89c8-d199516346a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:08.017256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff392fc-a27e-4664-8822-f383b02c30ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.017256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff392fc-a27e-4664-8822-f383b02c30ce admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.017256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff392fc-a27e-4664-8822-f383b02c30ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.017256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff392fc-a27e-4664-8822-f383b02c30ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.018418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff392fc-a27e-4664-8822-f383b02c30ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:08.020741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff392fc-a27e-4664-8822-f383b02c30ce admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:08.091077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 976/1944] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:08.092154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4719-90b7-4e83-89c8-d199516346a0 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.093634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7f1f4719-90b7-4e83-89c8-d199516346a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:08.107320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4719-90b7-4e83-89c8-d199516346a0 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.112323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.113022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.113318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.116257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] PATH_INFO: `/v3/users/f9d07f7cbe35441f9d94db0347c1be71` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.118160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:08.119149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d07f7cbe35441f9d94db0347c1be71)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:08.121238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:08.128881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 969/1945] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:07 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:08.133506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff392fc-a27e-4664-8822-f383b02c30ce admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.193968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff392fc-a27e-4664-8822-f383b02c30ce admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.197764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.198383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.198973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.198973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.200721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:08.260392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:08.261877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:08.270568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 970/1946] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:08.271367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.329510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d07f7cbe35441f9d94db0347c1be71'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:08.330212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d07f7cbe35441f9d94db0347c1be71'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:08.352176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:08.372725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d0d94-74a4-4c7d-9ef5-d5f227b4e15f service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.377891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.378542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.378971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.379175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.380387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:08.382028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:08.384499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d07f7cbe35441f9d94db0347c1be71'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:08.401159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d07f7cbe35441f9d94db0347c1be71'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:08.401995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-86f0b356-e0a0-444d-98c0-20f66262c54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d07f7cbe35441f9d94db0347c1be71'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:08.420653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 977/1947] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:08 2022] DELETE /identity/v3/users/f9d07f7cbe35441f9d94db0347c1be71 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:08.425192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b7c5a-06a8-429f-b319-fe55baaa7d5a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.425573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b7c5a-06a8-429f-b319-fe55baaa7d5a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.425853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b7c5a-06a8-429f-b319-fe55baaa7d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.448407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ce9b7c5a-06a8-429f-b319-fe55baaa7d5a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:08.449657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ce9b7c5a-06a8-429f-b319-fe55baaa7d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:08.453193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 971/1948] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:08 2022] POST /identity/v3/users => generated 282 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:08.457224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.458939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:08.471128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64330b24-b54b-440a-8f34-fedba91cef8b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.514747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 978/1949] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:08.526248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b7c5a-06a8-429f-b319-fe55baaa7d5a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.528714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ce9b7c5a-06a8-429f-b319-fe55baaa7d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:08.528910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fd66f-1678-41ed-bd80-a5dfef462a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.529533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd66f-1678-41ed-bd80-a5dfef462a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.529831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd66f-1678-41ed-bd80-a5dfef462a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.530196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fd66f-1678-41ed-bd80-a5dfef462a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.530974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fd66f-1678-41ed-bd80-a5dfef462a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:08.532742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fd66f-1678-41ed-bd80-a5dfef462a50 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:08.547905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 972/1950] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:32:08.549010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fd66f-1678-41ed-bd80-a5dfef462a50 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.559922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fd66f-1678-41ed-bd80-a5dfef462a50 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.564833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467de64-b411-44a0-8a7d-0f1592db9f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.565701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467de64-b411-44a0-8a7d-0f1592db9f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.566001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467de64-b411-44a0-8a7d-0f1592db9f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.566282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467de64-b411-44a0-8a7d-0f1592db9f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.566933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467de64-b411-44a0-8a7d-0f1592db9f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:08.568755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467de64-b411-44a0-8a7d-0f1592db9f0b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:08.579686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 973/1951] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:32:08.583884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467de64-b411-44a0-8a7d-0f1592db9f0b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.593169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b7c5a-06a8-429f-b319-fe55baaa7d5a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.594036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467de64-b411-44a0-8a7d-0f1592db9f0b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.597118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f4d2b-3770-4a31-a94b-5c31aa1ab420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.597770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f4d2b-3770-4a31-a94b-5c31aa1ab420 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.598041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f4d2b-3770-4a31-a94b-5c31aa1ab420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.602109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f4d2b-3770-4a31-a94b-5c31aa1ab420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.602222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.602222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.602222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.602222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] PATH_INFO: `/v3/projects/1276d55f40944ae0850eafb2203b47ae/users/de2679145c5d4d28b774fd050f483e9f/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.608158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f4d2b-3770-4a31-a94b-5c31aa1ab420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:08.609646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f4d2b-3770-4a31-a94b-5c31aa1ab420 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:08.616928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1276d55f40944ae0850eafb2203b47ae, user_id=de2679145c5d4d28b774fd050f483e9f, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:08.619995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:08.620516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 979/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:08.716099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 974/1953] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:08 2022] PUT /identity/v3/projects/1276d55f40944ae0850eafb2203b47ae/users/de2679145c5d4d28b774fd050f483e9f/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:08.722343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff6ab-97f0-4aa1-a450-2719c6e55ddc None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.722691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff6ab-97f0-4aa1-a450-2719c6e55ddc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.722976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff6ab-97f0-4aa1-a450-2719c6e55ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:08.755567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b6bff6ab-97f0-4aa1-a450-2719c6e55ddc None None] MFA Rules not processed for user `de2679145c5d4d28b774fd050f483e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:08.756923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b6bff6ab-97f0-4aa1-a450-2719c6e55ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:08.879451 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 980/1954] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:08.888931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:08.890877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:08.979204 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728eed-37be-480a-b66f-93f3fc5c5b9c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:08.983913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1a57-7934-4574-92ff-0d2bb45f7623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:08.984970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1a57-7934-4574-92ff-0d2bb45f7623 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:08.985263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1a57-7934-4574-92ff-0d2bb45f7623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:08.985538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1a57-7934-4574-92ff-0d2bb45f7623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:09.024872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd1a57-7934-4574-92ff-0d2bb45f7623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:09.029821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd1a57-7934-4574-92ff-0d2bb45f7623 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:09.056237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 975/1955] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:09.091354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff6ab-97f0-4aa1-a450-2719c6e55ddc None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:09.092917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b6bff6ab-97f0-4aa1-a450-2719c6e55ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:09.217557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff6ab-97f0-4aa1-a450-2719c6e55ddc None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:09.222045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:09.222698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:09.222984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:09.223280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] PATH_INFO: `/v3/projects/fe746b81dd644364ac264998dd26bece` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:09.224469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe746b81dd644364ac264998dd26bece)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:09.226430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:09.444383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe746b81dd644364ac264998dd26bece', 'request_id': 'req-7ebae74d-5fe6-4452-ae99-1a66800f7385'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:09.464052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe746b81dd644364ac264998dd26bece', 'request_id': 'req-7ebae74d-5fe6-4452-ae99-1a66800f7385'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:09.473289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe746b81dd644364ac264998dd26bece', 'request_id': 'req-7ebae74d-5fe6-4452-ae99-1a66800f7385'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:09.570263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] The token cache is being invalidate because project fe746b81dd644364ac264998dd26bece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:09.570785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:09.571726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:09.575061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 981/1956] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:09 2022] DELETE /identity/v3/projects/fe746b81dd644364ac264998dd26bece => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:09.579614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1a57-7934-4574-92ff-0d2bb45f7623 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:09.593027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd1a57-7934-4574-92ff-0d2bb45f7623 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:09.677272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:09.677915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:09.678193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:09.678465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] PATH_INFO: `/v3/users/04ab0c322336426ca103ffa76fd49f75` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:09.679629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ab0c322336426ca103ffa76fd49f75)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:09.684382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:09.936847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ab0c322336426ca103ffa76fd49f75'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:09.937615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ab0c322336426ca103ffa76fd49f75'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:10.057474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ab0c322336426ca103ffa76fd49f75'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:10.057474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ab0c322336426ca103ffa76fd49f75'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:10.076426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ab0c322336426ca103ffa76fd49f75'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:10.094444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 976/1957] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:09 2022] DELETE /identity/v3/users/04ab0c322336426ca103ffa76fd49f75 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:10.520444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:10.522764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:10.598216 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebae74d-5fe6-4452-ae99-1a66800f7385 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:10.661963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade560c-3bef-4533-944c-524c3f6dc3bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:10.662576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade560c-3bef-4533-944c-524c3f6dc3bf service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:10.662989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade560c-3bef-4533-944c-524c3f6dc3bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:10.663760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade560c-3bef-4533-944c-524c3f6dc3bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:10.665767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5ade560c-3bef-4533-944c-524c3f6dc3bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:10.728345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade560c-3bef-4533-944c-524c3f6dc3bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:10.729827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade560c-3bef-4533-944c-524c3f6dc3bf service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:10.745699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 982/1958] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:10.841995 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:10.843532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:10.925556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31db42f-8ff4-4d2b-9930-07dce097d213 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:10.931499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:10.932487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:10.932629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:10.932892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] PATH_INFO: `/v3/projects/311c462d8779486b9b264693f2295e58` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:10.934203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=311c462d8779486b9b264693f2295e58)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:10.936878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:10.950241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:11.074815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311c462d8779486b9b264693f2295e58', 'request_id': 'req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:11.084378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311c462d8779486b9b264693f2295e58', 'request_id': 'req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:11.097450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311c462d8779486b9b264693f2295e58', 'request_id': 'req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:11.162845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] The token cache is being invalidate because project 311c462d8779486b9b264693f2295e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:11.163351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:11.170567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7a0ffaf-f576-4791-a8a8-010d619cb9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:11.175759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 977/1959] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:10 2022] DELETE /identity/v3/projects/311c462d8779486b9b264693f2295e58 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:11.177536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17cc47-bef0-496a-a803-c13828871654 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:11.177827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17cc47-bef0-496a-a803-c13828871654 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:11.178111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17cc47-bef0-496a-a803-c13828871654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:11.236003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8c17cc47-bef0-496a-a803-c13828871654 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:11.239578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8c17cc47-bef0-496a-a803-c13828871654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:11.357756 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 983/1960] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:11.367123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355181f0-8ed6-4582-8983-766bef46d4a6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:11.367967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355181f0-8ed6-4582-8983-766bef46d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:11.368327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355181f0-8ed6-4582-8983-766bef46d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:11.380670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:11.412525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-355181f0-8ed6-4582-8983-766bef46d4a6 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:11.413963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-355181f0-8ed6-4582-8983-766bef46d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:11.426928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 978/1961] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:11.427671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17cc47-bef0-496a-a803-c13828871654 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:11.460277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17cc47-bef0-496a-a803-c13828871654 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:11.467562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:11.471475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:11.471769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:11.472046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:11.472735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:11.473087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:11.474786 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:11.495609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 984/1962] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:32:11.498047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355181f0-8ed6-4582-8983-766bef46d4a6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:11.509634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355181f0-8ed6-4582-8983-766bef46d4a6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:11.524671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e385-be5e-42a7-a090-4ef3c5193886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:11.525324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e385-be5e-42a7-a090-4ef3c5193886 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:11.525648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e385-be5e-42a7-a090-4ef3c5193886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:11.525922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67e385-be5e-42a7-a090-4ef3c5193886 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:11.526566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67e385-be5e-42a7-a090-4ef3c5193886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:11.528476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67e385-be5e-42a7-a090-4ef3c5193886 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:11.633554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 979/1963] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:11 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:11.640229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:11.656236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957aaec-b666-461e-9382-5e28e2942570 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:11.728099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6ea07-9b0b-4430-94eb-99949da75745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:11.729058 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ea07-9b0b-4430-94eb-99949da75745 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:11.729339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ea07-9b0b-4430-94eb-99949da75745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:11.729607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ea07-9b0b-4430-94eb-99949da75745 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:11.730240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6ea07-9b0b-4430-94eb-99949da75745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:11.732254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6ea07-9b0b-4430-94eb-99949da75745 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:11.865612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 985/1964] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:11 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:11.869951 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e385-be5e-42a7-a090-4ef3c5193886 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:11.880975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67e385-be5e-42a7-a090-4ef3c5193886 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:11.886817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72df3f6-a98e-474c-9868-8594b5566128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:11.887424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72df3f6-a98e-474c-9868-8594b5566128 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:11.887706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72df3f6-a98e-474c-9868-8594b5566128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:11.887978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72df3f6-a98e-474c-9868-8594b5566128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:11.888715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72df3f6-a98e-474c-9868-8594b5566128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:11.890348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72df3f6-a98e-474c-9868-8594b5566128 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:11.901092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 980/1965] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:11.905626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6ea07-9b0b-4430-94eb-99949da75745 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:11.916025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6ea07-9b0b-4430-94eb-99949da75745 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:11.920929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31104734-b696-4c1e-9a9a-6f35eee3754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:11.923032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104734-b696-4c1e-9a9a-6f35eee3754e admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:11.923032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104734-b696-4c1e-9a9a-6f35eee3754e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:11.923032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104734-b696-4c1e-9a9a-6f35eee3754e admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:11.923032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31104734-b696-4c1e-9a9a-6f35eee3754e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:11.924566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31104734-b696-4c1e-9a9a-6f35eee3754e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:11.937725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 986/1966] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:11.941984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72df3f6-a98e-474c-9868-8594b5566128 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:11.963172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72df3f6-a98e-474c-9868-8594b5566128 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:11.968430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cfe60-b514-46d1-8f73-f13bf534247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:11.969160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfe60-b514-46d1-8f73-f13bf534247d admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:11.969445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfe60-b514-46d1-8f73-f13bf534247d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:11.969724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cfe60-b514-46d1-8f73-f13bf534247d admin admin] PATH_INFO: `/v3/projects/80b0a81bdec54bf49612be8b3b1f010d/users/87f7c511250e4535a8412319889f3420/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:11.988311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cfe60-b514-46d1-8f73-f13bf534247d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b0a81bdec54bf49612be8b3b1f010d, user_id=87f7c511250e4535a8412319889f3420, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:11.992917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cfe60-b514-46d1-8f73-f13bf534247d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:12.076887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55742-373e-4474-8c12-04508164a561 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:12.077251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55742-373e-4474-8c12-04508164a561 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:12.077571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55742-373e-4474-8c12-04508164a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:12.083339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 981/1967] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:11 2022] PUT /identity/v3/projects/80b0a81bdec54bf49612be8b3b1f010d/users/87f7c511250e4535a8412319889f3420/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:12.115904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-31a55742-373e-4474-8c12-04508164a561 None None] MFA Rules not processed for user `87f7c511250e4535a8412319889f3420`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:12.117784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-31a55742-373e-4474-8c12-04508164a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:12.196912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 987/1968] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:12.201505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cfe60-b514-46d1-8f73-f13bf534247d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:12.269834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cfe60-b514-46d1-8f73-f13bf534247d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:12.277383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:12.277987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:12.278266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:12.278542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:12.282668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:12.282668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:12.385737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 982/1969] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:12 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:12.389820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55742-373e-4474-8c12-04508164a561 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:12.407483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55742-373e-4474-8c12-04508164a561 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:12.517945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a7b6-0b84-417f-8d57-8f07578b2e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:12.519061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a7b6-0b84-417f-8d57-8f07578b2e70 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:12.519589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a7b6-0b84-417f-8d57-8f07578b2e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:12.519970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0a7b6-0b84-417f-8d57-8f07578b2e70 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:12.521305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0a7b6-0b84-417f-8d57-8f07578b2e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:12.523955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0a7b6-0b84-417f-8d57-8f07578b2e70 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:12.607892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:12.609680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:12.679601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 988/1970] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:12 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:12.680108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5a0fc-3a8c-48b6-8b4d-d2a80bda5167 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:12.681065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a7b6-0b84-417f-8d57-8f07578b2e70 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:12.681902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:12.682728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:12.683103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:12.683471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:12.685572 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:12.701301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0a7b6-0b84-417f-8d57-8f07578b2e70 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:12.707382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff2485-a72a-42be-bc62-c46ac20edf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:12.708036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff2485-a72a-42be-bc62-c46ac20edf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:12.708445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff2485-a72a-42be-bc62-c46ac20edf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:12.708980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff2485-a72a-42be-bc62-c46ac20edf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:12.710476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff2485-a72a-42be-bc62-c46ac20edf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:12.712163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff2485-a72a-42be-bc62-c46ac20edf34 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:12.737127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 989/1971] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:12.740331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff2485-a72a-42be-bc62-c46ac20edf34 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:12.751723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff2485-a72a-42be-bc62-c46ac20edf34 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:12.760167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbf72c-ae4a-4749-9ea8-b5fdc77dbd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:12.761437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbf72c-ae4a-4749-9ea8-b5fdc77dbd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:12.761966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbf72c-ae4a-4749-9ea8-b5fdc77dbd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:12.762185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbf72c-ae4a-4749-9ea8-b5fdc77dbd56 admin admin] PATH_INFO: `/v3/projects/73efb0545c8649f38540bc7f39cfbca1/users/8da081f240dd482e8f2e0c4867c2844d/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:12.778278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbf72c-ae4a-4749-9ea8-b5fdc77dbd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73efb0545c8649f38540bc7f39cfbca1, user_id=8da081f240dd482e8f2e0c4867c2844d, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:12.780781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:12.781528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbf72c-ae4a-4749-9ea8-b5fdc77dbd56 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:12.782272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:12.799526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 983/1972] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:12.916916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 990/1973] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:12 2022] PUT /identity/v3/projects/73efb0545c8649f38540bc7f39cfbca1/users/8da081f240dd482e8f2e0c4867c2844d/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:12.921175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:12.933413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2232fa0-7c57-4d56-9195-8fdae5d24511 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:12.998250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac205a8-fc78-4af0-a6f0-8e2871bdf4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:12.998864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac205a8-fc78-4af0-a6f0-8e2871bdf4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:12.999181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac205a8-fc78-4af0-a6f0-8e2871bdf4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:12.999467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac205a8-fc78-4af0-a6f0-8e2871bdf4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:13.000116 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac205a8-fc78-4af0-a6f0-8e2871bdf4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:13.001758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac205a8-fc78-4af0-a6f0-8e2871bdf4ae admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:13.011960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 984/1974] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:13.017052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbf72c-ae4a-4749-9ea8-b5fdc77dbd56 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:13.027565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbf72c-ae4a-4749-9ea8-b5fdc77dbd56 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:13.032872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6c846-880f-4829-9603-636d086a3114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:13.033601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c846-880f-4829-9603-636d086a3114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:13.033883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c846-880f-4829-9603-636d086a3114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:13.034153 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c846-880f-4829-9603-636d086a3114 admin admin] PATH_INFO: `/v3/projects/73efb0545c8649f38540bc7f39cfbca1/users/8da081f240dd482e8f2e0c4867c2844d/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:13.036557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6c846-880f-4829-9603-636d086a3114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73efb0545c8649f38540bc7f39cfbca1, user_id=8da081f240dd482e8f2e0c4867c2844d, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:13.039241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6c846-880f-4829-9603-636d086a3114 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:13.053551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 991/1975] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:13 2022] PUT /identity/v3/projects/73efb0545c8649f38540bc7f39cfbca1/users/8da081f240dd482e8f2e0c4867c2844d/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:13.065228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b522d9-f72e-4925-9a1a-d8c8988c7e73 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:13.065520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b522d9-f72e-4925-9a1a-d8c8988c7e73 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:13.072920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b522d9-f72e-4925-9a1a-d8c8988c7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:13.102854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b5b522d9-f72e-4925-9a1a-d8c8988c7e73 None None] MFA Rules not processed for user `8da081f240dd482e8f2e0c4867c2844d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:13.104300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b5b522d9-f72e-4925-9a1a-d8c8988c7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:13.184858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 985/1976] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:13.195864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6c846-880f-4829-9603-636d086a3114 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:13.252422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6c846-880f-4829-9603-636d086a3114 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:13.256230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8608-babf-42aa-a2e2-7a3d7936fa7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:13.256858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8608-babf-42aa-a2e2-7a3d7936fa7b service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:13.257162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8608-babf-42aa-a2e2-7a3d7936fa7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:13.257441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8608-babf-42aa-a2e2-7a3d7936fa7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:13.319409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8608-babf-42aa-a2e2-7a3d7936fa7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:13.321238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab8608-babf-42aa-a2e2-7a3d7936fa7b service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:13.330752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 992/1977] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:13.391223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:13.774529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:16.425278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:16.704795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:18.234472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:18.588153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b522d9-f72e-4925-9a1a-d8c8988c7e73 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:18.691662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b522d9-f72e-4925-9a1a-d8c8988c7e73 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:18.698743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:18.700048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:18.700541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:18.700975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] PATH_INFO: `/v3/users/87f7c511250e4535a8412319889f3420` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:18.703142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f7c511250e4535a8412319889f3420)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:18.705832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:19.060140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f7c511250e4535a8412319889f3420'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:19.061077 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f7c511250e4535a8412319889f3420'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:19.133427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f7c511250e4535a8412319889f3420'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:19.134626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f7c511250e4535a8412319889f3420'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:19.160466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f7c511250e4535a8412319889f3420'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:19.191827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 986/1978] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:18 2022] DELETE /identity/v3/users/87f7c511250e4535a8412319889f3420 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:19.198001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d68ec-bbd2-4520-9a70-576588595683 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:19.199214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d68ec-bbd2-4520-9a70-576588595683 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:19.199788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d68ec-bbd2-4520-9a70-576588595683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:19.270305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-585d68ec-bbd2-4520-9a70-576588595683 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:19.272602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-585d68ec-bbd2-4520-9a70-576588595683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:19.421891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:19.423177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:19.428478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 993/1979] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:19.438502 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d68ec-bbd2-4520-9a70-576588595683 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:19.440587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-585d68ec-bbd2-4520-9a70-576588595683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:19.470570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d68ec-bbd2-4520-9a70-576588595683 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:19.477509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:19.487332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:19.490462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:19.490979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:19.491254 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] PATH_INFO: `/v3/users/d394176450aa492cbad22991d8c99f67` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:19.492889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d394176450aa492cbad22991d8c99f67)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:19.495125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:19.557838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce8732-6504-482a-bc18-740c40515d1b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:19.563015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5de41-7fa3-4e68-b6a5-6c6a26f0c8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:19.563660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5de41-7fa3-4e68-b6a5-6c6a26f0c8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:19.563945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5de41-7fa3-4e68-b6a5-6c6a26f0c8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:19.564220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5de41-7fa3-4e68-b6a5-6c6a26f0c8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:19.574810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5de41-7fa3-4e68-b6a5-6c6a26f0c8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:19.576290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5de41-7fa3-4e68-b6a5-6c6a26f0c8f8 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:19.588171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 987/1980] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:32:19.695090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:19.774309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd394176450aa492cbad22991d8c99f67'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:19.775142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd394176450aa492cbad22991d8c99f67'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.007837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd394176450aa492cbad22991d8c99f67'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.023335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd394176450aa492cbad22991d8c99f67'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.026076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd394176450aa492cbad22991d8c99f67'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.040410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 994/1981] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:19 2022] DELETE /identity/v3/users/d394176450aa492cbad22991d8c99f67 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:20.046741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441fdc3-63f1-4662-b043-9dea43979868 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:20.046741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441fdc3-63f1-4662-b043-9dea43979868 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:20.046741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441fdc3-63f1-4662-b043-9dea43979868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:20.077983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3441fdc3-63f1-4662-b043-9dea43979868 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:20.079242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3441fdc3-63f1-4662-b043-9dea43979868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:20.180440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 988/1982] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:20.189710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:20.196146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:20.283354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd202843-8a1e-45d6-b954-a1b6a31f2df1 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:20.287680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48be66-e664-47ab-8c12-ad9dcc6d7815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:20.288246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48be66-e664-47ab-8c12-ad9dcc6d7815 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:20.288632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48be66-e664-47ab-8c12-ad9dcc6d7815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:20.289041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48be66-e664-47ab-8c12-ad9dcc6d7815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:20.304817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48be66-e664-47ab-8c12-ad9dcc6d7815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:20.306430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48be66-e664-47ab-8c12-ad9dcc6d7815 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:20.317151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 995/1983] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:20.405561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441fdc3-63f1-4662-b043-9dea43979868 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:20.407713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3441fdc3-63f1-4662-b043-9dea43979868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:20.422722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441fdc3-63f1-4662-b043-9dea43979868 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:20.438904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:20.439844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:20.440297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:20.440726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] PATH_INFO: `/v3/projects/80b0a81bdec54bf49612be8b3b1f010d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:20.442971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b0a81bdec54bf49612be8b3b1f010d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:20.445949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:20.589529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b0a81bdec54bf49612be8b3b1f010d', 'request_id': 'req-3029b0cb-ae3b-4ee1-a258-487a8c687a42'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.597584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b0a81bdec54bf49612be8b3b1f010d', 'request_id': 'req-3029b0cb-ae3b-4ee1-a258-487a8c687a42'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.608121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b0a81bdec54bf49612be8b3b1f010d', 'request_id': 'req-3029b0cb-ae3b-4ee1-a258-487a8c687a42'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.694527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] The token cache is being invalidate because project 80b0a81bdec54bf49612be8b3b1f010d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:20.695397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.696347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:20.698822 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 989/1984] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:20 2022] DELETE /identity/v3/projects/80b0a81bdec54bf49612be8b3b1f010d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:20.702901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48be66-e664-47ab-8c12-ad9dcc6d7815 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:20.713125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48be66-e664-47ab-8c12-ad9dcc6d7815 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:20.773690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:20.774391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:20.774673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:20.774946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] PATH_INFO: `/v3/users/8da081f240dd482e8f2e0c4867c2844d` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:20.776119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da081f240dd482e8f2e0c4867c2844d)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:20.778183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:20.805670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:20.813804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:20.833505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029b0cb-ae3b-4ee1-a258-487a8c687a42 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:20.839430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:20.840214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:20.840542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:20.841060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] PATH_INFO: `/v3/projects/807cfa96a0494e5e96291e5abb20e78c` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:20.842474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=807cfa96a0494e5e96291e5abb20e78c)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:20.844560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:21.060241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807cfa96a0494e5e96291e5abb20e78c', 'request_id': 'req-8335eaf9-fb3f-4750-a96e-e227cccb7eec'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.060342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da081f240dd482e8f2e0c4867c2844d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.060897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da081f240dd482e8f2e0c4867c2844d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.068152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807cfa96a0494e5e96291e5abb20e78c', 'request_id': 'req-8335eaf9-fb3f-4750-a96e-e227cccb7eec'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.074163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807cfa96a0494e5e96291e5abb20e78c', 'request_id': 'req-8335eaf9-fb3f-4750-a96e-e227cccb7eec'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.110151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da081f240dd482e8f2e0c4867c2844d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.124426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da081f240dd482e8f2e0c4867c2844d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.125191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da081f240dd482e8f2e0c4867c2844d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.139652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 996/1985] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:20 2022] DELETE /identity/v3/users/8da081f240dd482e8f2e0c4867c2844d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:21.186687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] The token cache is being invalidate because project 807cfa96a0494e5e96291e5abb20e78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:21.187320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.188238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.190075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 990/1986] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:20 2022] DELETE /identity/v3/projects/807cfa96a0494e5e96291e5abb20e78c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:21.194655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:21.196161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:21.290388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa22c1-c41d-4224-aede-5936822bad80 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:21.297933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:21.299217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:21.299841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:21.300107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] PATH_INFO: `/v3/users/0683b767ab8a441baddeba858358a584` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:21.324086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0683b767ab8a441baddeba858358a584)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:21.328154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:21.561201 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0683b767ab8a441baddeba858358a584'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.561883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0683b767ab8a441baddeba858358a584'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.574746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:21.630628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0683b767ab8a441baddeba858358a584'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.657253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0683b767ab8a441baddeba858358a584'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.660710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0683b767ab8a441baddeba858358a584'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:21.697009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 997/1987] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:21 2022] DELETE /identity/v3/users/0683b767ab8a441baddeba858358a584 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:21.751130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:21.979185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:21.981899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:22.066564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335eaf9-fb3f-4750-a96e-e227cccb7eec admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:22.154398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69533853-65f3-433f-b426-92f699777589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:22.155584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533853-65f3-433f-b426-92f699777589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:22.156260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533853-65f3-433f-b426-92f699777589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:22.156865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533853-65f3-433f-b426-92f699777589 admin admin] PATH_INFO: `/v3/projects/73efb0545c8649f38540bc7f39cfbca1` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:22.158363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69533853-65f3-433f-b426-92f699777589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73efb0545c8649f38540bc7f39cfbca1)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:22.160531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69533853-65f3-433f-b426-92f699777589 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:22.330255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:22.330255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:22.339719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-69533853-65f3-433f-b426-92f699777589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73efb0545c8649f38540bc7f39cfbca1', 'request_id': 'req-69533853-65f3-433f-b426-92f699777589'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.349504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-69533853-65f3-433f-b426-92f699777589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73efb0545c8649f38540bc7f39cfbca1', 'request_id': 'req-69533853-65f3-433f-b426-92f699777589'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.359132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-69533853-65f3-433f-b426-92f699777589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73efb0545c8649f38540bc7f39cfbca1', 'request_id': 'req-69533853-65f3-433f-b426-92f699777589'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.369413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337947a-a98a-42a0-ac45-fb8510e35a7a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:22.454059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:22.454885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:22.455292 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:22.455656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] PATH_INFO: `/v3/projects/648dd9c86a324d32b48a012e3cbc4dac` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:22.459544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=648dd9c86a324d32b48a012e3cbc4dac)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:22.462899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:22.497109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-69533853-65f3-433f-b426-92f699777589 admin admin] The token cache is being invalidate because project 73efb0545c8649f38540bc7f39cfbca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:22.497109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-69533853-65f3-433f-b426-92f699777589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.497109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-69533853-65f3-433f-b426-92f699777589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.499763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 991/1988] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:21 2022] DELETE /identity/v3/projects/73efb0545c8649f38540bc7f39cfbca1 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:22.504715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaea0c-f534-4e23-a08a-04c2b8050d10 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:22.505027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaea0c-f534-4e23-a08a-04c2b8050d10 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:22.505313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaea0c-f534-4e23-a08a-04c2b8050d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:22.531709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c9aaea0c-f534-4e23-a08a-04c2b8050d10 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:22.533221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c9aaea0c-f534-4e23-a08a-04c2b8050d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:22.559173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 992/1989] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:22.562961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ee7a1-3557-4334-b1c6-a24fa3e8e32e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:22.563598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ee7a1-3557-4334-b1c6-a24fa3e8e32e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:22.564081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ee7a1-3557-4334-b1c6-a24fa3e8e32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:22.594937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8c9ee7a1-3557-4334-b1c6-a24fa3e8e32e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:22.596895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8c9ee7a1-3557-4334-b1c6-a24fa3e8e32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:22.612317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 993/1990] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:22.613912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ee7a1-3557-4334-b1c6-a24fa3e8e32e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:22.628617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ee7a1-3557-4334-b1c6-a24fa3e8e32e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:22.637719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:22.638388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:22.638819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:22.639100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:22.640340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:22.640689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:22.642306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:22.674028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 994/1991] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:32:22.678643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:22.694959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07762ba-3ef7-4d01-9b34-218c2f24be1d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:22.695241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648dd9c86a324d32b48a012e3cbc4dac', 'request_id': 'req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.703574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648dd9c86a324d32b48a012e3cbc4dac', 'request_id': 'req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.712216 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648dd9c86a324d32b48a012e3cbc4dac', 'request_id': 'req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.795405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] The token cache is being invalidate because project 648dd9c86a324d32b48a012e3cbc4dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:22.795698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.796613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:22.798660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 998/1992] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:22 2022] DELETE /identity/v3/projects/648dd9c86a324d32b48a012e3cbc4dac => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:22.803221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:22.805289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:22.807548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:22.808357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:22.808706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:22.809083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:22.809862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:22.812071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:22.844001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6d74-29e7-4799-b0d4-50703c6dc4ea admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:22.850797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:22.851619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:22.852698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:22.853182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] PATH_INFO: `/v3/users/be97555af6da426189dcb7156a8764a7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:22.855255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be97555af6da426189dcb7156a8764a7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:22.857710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:22.981812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 995/1993] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:22 2022] POST /identity/v3/projects => generated 377 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:22.986217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:22.987918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:23.070797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f40b9-3263-4d8c-9288-669763181474 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:23.075863 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:23.076492 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:23.076777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:23.077093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:23.077742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:23.079740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:23.114733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be97555af6da426189dcb7156a8764a7'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:23.115495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be97555af6da426189dcb7156a8764a7'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:23.207776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be97555af6da426189dcb7156a8764a7'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:23.216601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 996/1994] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:22 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:23.220523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:23.222281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:23.222883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be97555af6da426189dcb7156a8764a7'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:23.223791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be97555af6da426189dcb7156a8764a7'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:23.236503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a47ae-7336-43c4-b107-f713c58af65c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:23.240225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 999/1995] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:22 2022] DELETE /identity/v3/users/be97555af6da426189dcb7156a8764a7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:23.262827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:23.320152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243f7ed-8b09-4562-a007-baf9c104dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:23.322436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f7ed-8b09-4562-a007-baf9c104dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:23.323559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f7ed-8b09-4562-a007-baf9c104dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:23.323847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f7ed-8b09-4562-a007-baf9c104dbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:23.324530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243f7ed-8b09-4562-a007-baf9c104dbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:23.326300 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243f7ed-8b09-4562-a007-baf9c104dbf2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:23.343257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 997/1996] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:23.344611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:23.360982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb840e9-1a23-4e15-8b31-2f13bd14c20a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:23.360982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31d78e-6121-4e9b-a869-53e9b5b5bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:23.360982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d78e-6121-4e9b-a869-53e9b5b5bfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:23.360982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d78e-6121-4e9b-a869-53e9b5b5bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:23.361380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d78e-6121-4e9b-a869-53e9b5b5bfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:23.361882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d78e-6121-4e9b-a869-53e9b5b5bfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:23.363490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d78e-6121-4e9b-a869-53e9b5b5bfa4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:23.374598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1000/1997] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:23.378963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243f7ed-8b09-4562-a007-baf9c104dbf2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:23.388731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243f7ed-8b09-4562-a007-baf9c104dbf2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:23.393335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:23.393979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:23.395040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:23.395040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] PATH_INFO: `/v3/projects/028a1c90d0ac45b1be85fdd169fc5b7a/users/72b12fa1477e4c5a8ae72225f5c8a970/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:23.408864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028a1c90d0ac45b1be85fdd169fc5b7a, user_id=72b12fa1477e4c5a8ae72225f5c8a970, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:23.412073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:23.487302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:23.502956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 998/1998] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:23 2022] PUT /identity/v3/projects/028a1c90d0ac45b1be85fdd169fc5b7a/users/72b12fa1477e4c5a8ae72225f5c8a970/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:23.515020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5aebb-7945-452b-92e1-139275351540 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:23.515380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5aebb-7945-452b-92e1-139275351540 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:23.515797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5aebb-7945-452b-92e1-139275351540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:23.563818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-78b5aebb-7945-452b-92e1-139275351540 None None] MFA Rules not processed for user `72b12fa1477e4c5a8ae72225f5c8a970`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:23.565617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-78b5aebb-7945-452b-92e1-139275351540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:23.669002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1001/1999] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:23.692025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:23.697429 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:23.764155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5aebb-7945-452b-92e1-139275351540 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:23.766054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-78b5aebb-7945-452b-92e1-139275351540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:23.781832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6af56-1970-40a9-81da-7b4a5bcceb49 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:23.786536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043de77-3dae-4870-bbb0-cf3e1fc27b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:23.787173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043de77-3dae-4870-bbb0-cf3e1fc27b98 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:23.787461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043de77-3dae-4870-bbb0-cf3e1fc27b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:23.787738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043de77-3dae-4870-bbb0-cf3e1fc27b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:23.798844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043de77-3dae-4870-bbb0-cf3e1fc27b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:23.801935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043de77-3dae-4870-bbb0-cf3e1fc27b98 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:23.813750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 999/2000] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:23.851903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5aebb-7945-452b-92e1-139275351540 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:23.857942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:23.857942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:23.857942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:23.859819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] PATH_INFO: `/v3/projects/453ec97905d9415d9f933035777c6d55` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:23.861049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453ec97905d9415d9f933035777c6d55)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:23.868483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:24.044796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453ec97905d9415d9f933035777c6d55', 'request_id': 'req-f90b3bd0-4906-40d0-b767-703dad1c4926'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:24.055117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453ec97905d9415d9f933035777c6d55', 'request_id': 'req-f90b3bd0-4906-40d0-b767-703dad1c4926'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:24.070918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453ec97905d9415d9f933035777c6d55', 'request_id': 'req-f90b3bd0-4906-40d0-b767-703dad1c4926'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:24.180059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] The token cache is being invalidate because project 453ec97905d9415d9f933035777c6d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:24.180059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:24.180059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f90b3bd0-4906-40d0-b767-703dad1c4926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:24.180059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1002/2001] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:23 2022] DELETE /identity/v3/projects/453ec97905d9415d9f933035777c6d55 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:24.180373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175a5f-fff9-47f3-87c6-a306c6358ef5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.180373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175a5f-fff9-47f3-87c6-a306c6358ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.180873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175a5f-fff9-47f3-87c6-a306c6358ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:24.204094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8a175a5f-fff9-47f3-87c6-a306c6358ef5 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:24.205359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8a175a5f-fff9-47f3-87c6-a306c6358ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:24.279922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1000/2002] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:24.290005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655341-caf1-4b29-b17c-1b360a76e8eb None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.290396 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655341-caf1-4b29-b17c-1b360a76e8eb None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.291356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655341-caf1-4b29-b17c-1b360a76e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:24.318822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-46655341-caf1-4b29-b17c-1b360a76e8eb None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:24.320122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-46655341-caf1-4b29-b17c-1b360a76e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:24.328214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1003/2003] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:24.332691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175a5f-fff9-47f3-87c6-a306c6358ef5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:24.342718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175a5f-fff9-47f3-87c6-a306c6358ef5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:24.347318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:24.347950 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.348267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.349106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:24.349764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:24.350074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:24.351666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:24.366713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1001/2004] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:24.369087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46655341-caf1-4b29-b17c-1b360a76e8eb None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:24.378282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46655341-caf1-4b29-b17c-1b360a76e8eb None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:24.383113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d51ef-a917-490b-b75b-2b7b6dfcfa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:24.383666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d51ef-a917-490b-b75b-2b7b6dfcfa10 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.383941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d51ef-a917-490b-b75b-2b7b6dfcfa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.384211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d51ef-a917-490b-b75b-2b7b6dfcfa10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:24.384842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d51ef-a917-490b-b75b-2b7b6dfcfa10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:24.386775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d51ef-a917-490b-b75b-2b7b6dfcfa10 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:24.486131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1004/2005] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:24 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:24.487917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:24.502926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9ec9d-b994-4e11-9c47-6991de363598 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:24.577213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c4dce-3eee-437d-8a36-bf8ce6367f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:24.577836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4dce-3eee-437d-8a36-bf8ce6367f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.578123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4dce-3eee-437d-8a36-bf8ce6367f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.578401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4dce-3eee-437d-8a36-bf8ce6367f1d admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:24.579049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c4dce-3eee-437d-8a36-bf8ce6367f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:24.581068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c4dce-3eee-437d-8a36-bf8ce6367f1d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:24.712625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1002/2006] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:24 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:24.717260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d51ef-a917-490b-b75b-2b7b6dfcfa10 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:24.728854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d51ef-a917-490b-b75b-2b7b6dfcfa10 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:24.734105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4a4b-ea44-4035-843f-10295ac00e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:24.735305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4a4b-ea44-4035-843f-10295ac00e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.735737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4a4b-ea44-4035-843f-10295ac00e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.736041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a4a4b-ea44-4035-843f-10295ac00e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:24.736723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4a4b-ea44-4035-843f-10295ac00e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:24.738492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a4a4b-ea44-4035-843f-10295ac00e4c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:24.752147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1005/2007] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:24.756276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c4dce-3eee-437d-8a36-bf8ce6367f1d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:24.767554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c4dce-3eee-437d-8a36-bf8ce6367f1d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:24.773106 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157f04f-b78d-4d24-9305-d817ae9ac68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:24.773878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f04f-b78d-4d24-9305-d817ae9ac68b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.774163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f04f-b78d-4d24-9305-d817ae9ac68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.774433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157f04f-b78d-4d24-9305-d817ae9ac68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:24.775111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157f04f-b78d-4d24-9305-d817ae9ac68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:24.776781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157f04f-b78d-4d24-9305-d817ae9ac68b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:24.789073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1003/2008] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:24.793379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4a4b-ea44-4035-843f-10295ac00e4c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:24.805657 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a4a4b-ea44-4035-843f-10295ac00e4c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:24.813812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:24.814679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.815081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.815544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] PATH_INFO: `/v3/projects/344feae5672b48f2b62be37c736937ce/users/b800d9a7d9e1452ab6f7a683b248c091/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:24.835800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] RBAC: Authorizing `identity:create_grant(project_id=344feae5672b48f2b62be37c736937ce, user_id=b800d9a7d9e1452ab6f7a683b248c091, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:24.835968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:24.838917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:24.967478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1006/2009] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:24 2022] PUT /identity/v3/projects/344feae5672b48f2b62be37c736937ce/users/b800d9a7d9e1452ab6f7a683b248c091/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:24.978065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d07001-81a8-42aa-904e-49ab14ad2993 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:24.978349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d07001-81a8-42aa-904e-49ab14ad2993 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:24.983225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d07001-81a8-42aa-904e-49ab14ad2993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:25.006377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-36d07001-81a8-42aa-904e-49ab14ad2993 None None] MFA Rules not processed for user `b800d9a7d9e1452ab6f7a683b248c091`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:25.007783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-36d07001-81a8-42aa-904e-49ab14ad2993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:25.074442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1004/2010] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:25.088624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:25.090583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:25.155355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39deac7-8d28-4115-82a2-ce02154a216b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:25.159128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016c5cb-8d7f-411e-8606-b2f97d7986b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:25.161417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016c5cb-8d7f-411e-8606-b2f97d7986b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:25.161417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016c5cb-8d7f-411e-8606-b2f97d7986b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:25.161417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016c5cb-8d7f-411e-8606-b2f97d7986b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:25.169003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016c5cb-8d7f-411e-8606-b2f97d7986b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:25.170423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016c5cb-8d7f-411e-8606-b2f97d7986b1 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:25.179866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1007/2011] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:25.579249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:26.196186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:26.997061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5feca2-171b-4db4-b622-f42dab966519 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:27.000629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5feca2-171b-4db4-b622-f42dab966519 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:27.000629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5feca2-171b-4db4-b622-f42dab966519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:27.017420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4e5feca2-171b-4db4-b622-f42dab966519 None None] MFA Rules not processed for user `b800d9a7d9e1452ab6f7a683b248c091`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:27.018641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4e5feca2-171b-4db4-b622-f42dab966519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:27.038895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1005/2012] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:27.306481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:27.407630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:28.265190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:28.969135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:29.414023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:29.757892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:29.955839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:30.368117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:30.460507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:30.772937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:30.951049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:31.077305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:31.197152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:31.905781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9e492-9cf7-45d7-85b0-88b14525ef67 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:31.906382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9e492-9cf7-45d7-85b0-88b14525ef67 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:31.906902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9e492-9cf7-45d7-85b0-88b14525ef67 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:31.909588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1008/2013] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:32:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:32:31.940540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e4a4-b7aa-441c-87eb-cdbed9a7d9e8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:31.941209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e4a4-b7aa-441c-87eb-cdbed9a7d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:31.941209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431e4a4-b7aa-441c-87eb-cdbed9a7d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:31.968159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7431e4a4-b7aa-441c-87eb-cdbed9a7d9e8 None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:31.970332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7431e4a4-b7aa-441c-87eb-cdbed9a7d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:31.980261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:32.075107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9e492-9cf7-45d7-85b0-88b14525ef67 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:32.077248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f2c9e492-9cf7-45d7-85b0-88b14525ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:32.109506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1006/2014] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:32.124894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d395d-bcbc-4d45-8849-c6072fa37991 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:32.126765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d395d-bcbc-4d45-8849-c6072fa37991 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:32.127061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d395d-bcbc-4d45-8849-c6072fa37991 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:32.132217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1007/2015] 10.222.0.39 () {54 vars in 961 bytes} [Mon Sep 5 12:32:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:32:32.139482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac5a2-ea1e-4925-be4b-cda5f2f7d02d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:32.139482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac5a2-ea1e-4925-be4b-cda5f2f7d02d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:32.139482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac5a2-ea1e-4925-be4b-cda5f2f7d02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:32.160608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f9dac5a2-ea1e-4925-be4b-cda5f2f7d02d None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:32.161898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f9dac5a2-ea1e-4925-be4b-cda5f2f7d02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:32.170981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1008/2016] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Sep 5 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:32.179793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac5a2-ea1e-4925-be4b-cda5f2f7d02d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:32.182892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9e492-9cf7-45d7-85b0-88b14525ef67 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:32.187806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:32.190993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:32.190993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:32.190993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] PATH_INFO: `/v3/users/2dfd3630ab154bfca63048bcecc758c9` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:32.191273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac5a2-ea1e-4925-be4b-cda5f2f7d02d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:32.191351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfd3630ab154bfca63048bcecc758c9)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:32.192846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:32.196090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb643cbe-05de-4c31-8891-72c8b59430ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:32.196818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb643cbe-05de-4c31-8891-72c8b59430ce service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:32.197224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb643cbe-05de-4c31-8891-72c8b59430ce service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:32.197569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb643cbe-05de-4c31-8891-72c8b59430ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:32.206306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb643cbe-05de-4c31-8891-72c8b59430ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:32.207967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb643cbe-05de-4c31-8891-72c8b59430ce service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:32.221668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1009/2017] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:32.316451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:32.410791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfd3630ab154bfca63048bcecc758c9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:32.411810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfd3630ab154bfca63048bcecc758c9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:32.464359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfd3630ab154bfca63048bcecc758c9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:32.478864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfd3630ab154bfca63048bcecc758c9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:32.479644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-0f8df3c0-bcc8-400b-a4b7-638bf476b4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfd3630ab154bfca63048bcecc758c9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:32.494079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1009/2018] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:32 2022] DELETE /identity/v3/users/2dfd3630ab154bfca63048bcecc758c9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:32.772457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb643cbe-05de-4c31-8891-72c8b59430ce service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:32.790419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb643cbe-05de-4c31-8891-72c8b59430ce service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:32.922552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:32.922552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:32.922552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:32.922552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] PATH_INFO: `/v3/projects/b36f32d54f934ed796077c0253081559` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:32.922908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36f32d54f934ed796077c0253081559)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:32.922908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:33.105456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36f32d54f934ed796077c0253081559', 'request_id': 'req-526d1125-947a-4085-bb22-9058d1fbad1d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:33.114729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36f32d54f934ed796077c0253081559', 'request_id': 'req-526d1125-947a-4085-bb22-9058d1fbad1d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:33.121275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36f32d54f934ed796077c0253081559', 'request_id': 'req-526d1125-947a-4085-bb22-9058d1fbad1d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:33.225971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] The token cache is being invalidate because project b36f32d54f934ed796077c0253081559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:33.226745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:33.226992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-526d1125-947a-4085-bb22-9058d1fbad1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:33.228526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1010/2019] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:32 2022] DELETE /identity/v3/projects/b36f32d54f934ed796077c0253081559 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:33.234495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85d5b-9f48-4aa7-bafb-fafbb6ab1890 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:33.235516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85d5b-9f48-4aa7-bafb-fafbb6ab1890 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:33.235799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf85d5b-9f48-4aa7-bafb-fafbb6ab1890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:33.261266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-dcf85d5b-9f48-4aa7-bafb-fafbb6ab1890 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:33.262746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-dcf85d5b-9f48-4aa7-bafb-fafbb6ab1890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:33.278321 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:33.340422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1010/2020] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:33.342150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac3bf-a551-494d-8773-4a3e8f207b20 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:33.342453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac3bf-a551-494d-8773-4a3e8f207b20 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:33.342750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ac3bf-a551-494d-8773-4a3e8f207b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:33.369568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f75ac3bf-a551-494d-8773-4a3e8f207b20 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:33.373299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f75ac3bf-a551-494d-8773-4a3e8f207b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:33.381119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1011/2021] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:33.385992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf85d5b-9f48-4aa7-bafb-fafbb6ab1890 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:33.397975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf85d5b-9f48-4aa7-bafb-fafbb6ab1890 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:33.405164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:33.405809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:33.406093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:33.406369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:33.407206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:33.407513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:33.409208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:33.421678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1011/2022] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:33.426186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ac3bf-a551-494d-8773-4a3e8f207b20 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:33.435771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ac3bf-a551-494d-8773-4a3e8f207b20 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:33.440640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04751c47-64b8-4fa9-bfd4-258d48989ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:33.441371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04751c47-64b8-4fa9-bfd4-258d48989ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:33.441651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04751c47-64b8-4fa9-bfd4-258d48989ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:33.441981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04751c47-64b8-4fa9-bfd4-258d48989ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:33.442591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04751c47-64b8-4fa9-bfd4-258d48989ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:33.445084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04751c47-64b8-4fa9-bfd4-258d48989ef3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:33.456765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:33.563781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1012/2023] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:33 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:33.568061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:33.578999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e33fe3-dc1b-4cd5-9a02-5b19b8b2395e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:33.640870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f89c39-b860-4f54-83e9-7815b4c968a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:33.641556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f89c39-b860-4f54-83e9-7815b4c968a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:33.641841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f89c39-b860-4f54-83e9-7815b4c968a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:33.642116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f89c39-b860-4f54-83e9-7815b4c968a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:33.642770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f89c39-b860-4f54-83e9-7815b4c968a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:33.644662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f89c39-b860-4f54-83e9-7815b4c968a5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:33.731680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1012/2024] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:33 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:33.737779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04751c47-64b8-4fa9-bfd4-258d48989ef3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:33.756284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04751c47-64b8-4fa9-bfd4-258d48989ef3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:33.765012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b61a-9eb1-4058-a372-367fd9a8509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:33.771002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b61a-9eb1-4058-a372-367fd9a8509e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:33.771002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b61a-9eb1-4058-a372-367fd9a8509e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:33.771002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520b61a-9eb1-4058-a372-367fd9a8509e admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:33.771002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520b61a-9eb1-4058-a372-367fd9a8509e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:33.771002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520b61a-9eb1-4058-a372-367fd9a8509e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:33.794470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1013/2025] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:33.806061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f89c39-b860-4f54-83e9-7815b4c968a5 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:33.817459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f89c39-b860-4f54-83e9-7815b4c968a5 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:33.823615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ba17f-a445-48cb-b74c-6107db9f5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:33.824381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba17f-a445-48cb-b74c-6107db9f5ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:33.824672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba17f-a445-48cb-b74c-6107db9f5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:33.824967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba17f-a445-48cb-b74c-6107db9f5ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:33.825633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ba17f-a445-48cb-b74c-6107db9f5ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:33.827525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ba17f-a445-48cb-b74c-6107db9f5ec0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:33.844001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1013/2026] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:33.845434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b61a-9eb1-4058-a372-367fd9a8509e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:33.856862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520b61a-9eb1-4058-a372-367fd9a8509e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:33.862665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:33.863666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:33.864026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:33.864381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] PATH_INFO: `/v3/projects/973a10fbc2bc4fcca77949b1d1c13bc4/users/1f4082dcfbf748899cdf58dc4bdb9048/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:33.884072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973a10fbc2bc4fcca77949b1d1c13bc4, user_id=1f4082dcfbf748899cdf58dc4bdb9048, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:33.886933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:33.997577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1014/2027] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:33 2022] PUT /identity/v3/projects/973a10fbc2bc4fcca77949b1d1c13bc4/users/1f4082dcfbf748899cdf58dc4bdb9048/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:34.008051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0d21-0321-4106-9afe-052a29e539a3 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:34.008338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0d21-0321-4106-9afe-052a29e539a3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:34.009574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0d21-0321-4106-9afe-052a29e539a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:34.037891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-d73b0d21-0321-4106-9afe-052a29e539a3 None None] MFA Rules not processed for user `1f4082dcfbf748899cdf58dc4bdb9048`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:34.039093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d73b0d21-0321-4106-9afe-052a29e539a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:34.120818 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:34.144406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1014/2028] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:34.163324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:34.175105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:34.179109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:34.281705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706fe1e-2148-43ee-99fb-8b749c750b69 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:34.289578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3ea29-2656-44be-a284-519b380564f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:34.290766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ea29-2656-44be-a284-519b380564f7 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:34.290766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ea29-2656-44be-a284-519b380564f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:34.291066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3ea29-2656-44be-a284-519b380564f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:34.300842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3ea29-2656-44be-a284-519b380564f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:34.302782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3ea29-2656-44be-a284-519b380564f7 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:34.313111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1015/2029] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:34.596438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:34.722103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:35.115494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:35.516375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:40.081988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0d21-0321-4106-9afe-052a29e539a3 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:40.083471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d73b0d21-0321-4106-9afe-052a29e539a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:40.165807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0d21-0321-4106-9afe-052a29e539a3 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:40.170902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:40.171558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:40.172165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:40.172517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] PATH_INFO: `/v3/users/72b12fa1477e4c5a8ae72225f5c8a970` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:40.173880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b12fa1477e4c5a8ae72225f5c8a970)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:40.175956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:40.370686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b12fa1477e4c5a8ae72225f5c8a970'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:40.371355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b12fa1477e4c5a8ae72225f5c8a970'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:40.441780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b12fa1477e4c5a8ae72225f5c8a970'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:40.461092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b12fa1477e4c5a8ae72225f5c8a970'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:40.461829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b12fa1477e4c5a8ae72225f5c8a970'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:40.475083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1015/2030] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:40 2022] DELETE /identity/v3/users/72b12fa1477e4c5a8ae72225f5c8a970 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:40.479038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34d09-0520-4d2b-8405-5b0e6d1f32bf None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:40.479636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34d09-0520-4d2b-8405-5b0e6d1f32bf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:40.479636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34d09-0520-4d2b-8405-5b0e6d1f32bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:40.501350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-82b34d09-0520-4d2b-8405-5b0e6d1f32bf None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:40.502622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-82b34d09-0520-4d2b-8405-5b0e6d1f32bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:40.538312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:40.583658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1016/2031] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:40.601314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:40.602837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:40.620915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34d09-0520-4d2b-8405-5b0e6d1f32bf None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:40.621850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-82b34d09-0520-4d2b-8405-5b0e6d1f32bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:40.636288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34d09-0520-4d2b-8405-5b0e6d1f32bf None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:40.643235 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:40.643842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:40.644159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:40.644467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] PATH_INFO: `/v3/users/1f4082dcfbf748899cdf58dc4bdb9048` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:40.646394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:40.646596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4082dcfbf748899cdf58dc4bdb9048)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:40.648692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:40.682881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7cb95-bd0d-4191-a944-46f04fa46b6c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:40.686681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdfded-0069-4b18-acb8-9906fef8a25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:40.701812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdfded-0069-4b18-acb8-9906fef8a25b service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:40.701812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdfded-0069-4b18-acb8-9906fef8a25b service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:40.701812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdfded-0069-4b18-acb8-9906fef8a25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:40.701812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdfded-0069-4b18-acb8-9906fef8a25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:40.701812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdfded-0069-4b18-acb8-9906fef8a25b service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:40.711445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1016/2032] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:40.907898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4082dcfbf748899cdf58dc4bdb9048'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:40.908559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4082dcfbf748899cdf58dc4bdb9048'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:40.990582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4082dcfbf748899cdf58dc4bdb9048'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:40.991457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4082dcfbf748899cdf58dc4bdb9048'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:41.006297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4082dcfbf748899cdf58dc4bdb9048'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:41.020246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1017/2033] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:40 2022] DELETE /identity/v3/users/1f4082dcfbf748899cdf58dc4bdb9048 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:41.025414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dc96-33f0-417e-bb22-fb5364d966dc None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.025705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dc96-33f0-417e-bb22-fb5364d966dc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.026044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8dc96-33f0-417e-bb22-fb5364d966dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.047193 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-78a8dc96-33f0-417e-bb22-fb5364d966dc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:41.049039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-78a8dc96-33f0-417e-bb22-fb5364d966dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:41.120298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1017/2034] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:41.131031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:41.132897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:41.191683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dc96-33f0-417e-bb22-fb5364d966dc None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:41.193168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-78a8dc96-33f0-417e-bb22-fb5364d966dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:41.195463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608898aa-92d1-41d7-917f-56b897ccec32 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:41.206371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84e218-dbec-4f7d-b46a-33b1cf09f580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:41.207359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e218-dbec-4f7d-b46a-33b1cf09f580 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.207508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8dc96-33f0-417e-bb22-fb5364d966dc None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:41.207871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e218-dbec-4f7d-b46a-33b1cf09f580 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.208747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e218-dbec-4f7d-b46a-33b1cf09f580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.215603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:41.216283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.216648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.216925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] PATH_INFO: `/v3/projects/028a1c90d0ac45b1be85fdd169fc5b7a` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.218469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] RBAC: Authorizing `identity:delete_project(project_id=028a1c90d0ac45b1be85fdd169fc5b7a)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:41.220556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:41.226529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84e218-dbec-4f7d-b46a-33b1cf09f580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:41.235581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84e218-dbec-4f7d-b46a-33b1cf09f580 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:41.248678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1018/2035] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:32:41.344334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028a1c90d0ac45b1be85fdd169fc5b7a', 'request_id': 'req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:41.351368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028a1c90d0ac45b1be85fdd169fc5b7a', 'request_id': 'req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:41.360757 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028a1c90d0ac45b1be85fdd169fc5b7a', 'request_id': 'req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:41.480184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] The token cache is being invalidate because project 028a1c90d0ac45b1be85fdd169fc5b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:41.480475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:41.481186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b2ec21b4-b4fc-4501-b88f-9ac5e281310e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:41.482996 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1018/2036] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:41 2022] DELETE /identity/v3/projects/028a1c90d0ac45b1be85fdd169fc5b7a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:41.487743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce270-6a39-49d6-9623-2dc33ee90cc7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.488237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce270-6a39-49d6-9623-2dc33ee90cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.488237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ce270-6a39-49d6-9623-2dc33ee90cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.509596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-af1ce270-6a39-49d6-9623-2dc33ee90cc7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:41.515695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-af1ce270-6a39-49d6-9623-2dc33ee90cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:41.562801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:41.588787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1019/2037] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:41.599935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ccac4-2506-4dd7-801e-a9d440d60678 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.600302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ccac4-2506-4dd7-801e-a9d440d60678 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.600583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ccac4-2506-4dd7-801e-a9d440d60678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.624729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-426ccac4-2506-4dd7-801e-a9d440d60678 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:41.626034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-426ccac4-2506-4dd7-801e-a9d440d60678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:41.635633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1019/2038] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:41.639987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ce270-6a39-49d6-9623-2dc33ee90cc7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:41.650482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ce270-6a39-49d6-9623-2dc33ee90cc7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:41.656712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:41.657366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.657642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.657983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.658649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:41.658954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:41.660570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:41.674778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1020/2039] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:41.679928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ccac4-2506-4dd7-801e-a9d440d60678 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:41.696908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ccac4-2506-4dd7-801e-a9d440d60678 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:41.706301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:41.707139 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.710744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.710744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.710744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:41.710744 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:41.793556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1020/2040] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:41 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:41.797705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:41.809340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c559-eaa5-4e2d-9e96-a80a7e3fe120 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:41.890601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:41.892839 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:41.896879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d35e27-ea40-4519-9481-238bc337bbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:41.897614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d35e27-ea40-4519-9481-238bc337bbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.897963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d35e27-ea40-4519-9481-238bc337bbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.898620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d35e27-ea40-4519-9481-238bc337bbb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.898967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d35e27-ea40-4519-9481-238bc337bbb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:41.900895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d35e27-ea40-4519-9481-238bc337bbb5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:41.913480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7106a2-8230-4844-b86c-a2b0cea2e7fa admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:41.920123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:41.920967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:41.921264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:41.921536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] PATH_INFO: `/v3/projects/973a10fbc2bc4fcca77949b1d1c13bc4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:41.922708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973a10fbc2bc4fcca77949b1d1c13bc4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:41.924688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:41.952238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:41.991154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1021/2041] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:41 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:41.995358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d35e27-ea40-4519-9481-238bc337bbb5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.005578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d35e27-ea40-4519-9481-238bc337bbb5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.010835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1d43d-e542-4be9-93d6-9f1db372cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.011438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d43d-e542-4be9-93d6-9f1db372cd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.011717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d43d-e542-4be9-93d6-9f1db372cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.011988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1d43d-e542-4be9-93d6-9f1db372cd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.012632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1d43d-e542-4be9-93d6-9f1db372cd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.014259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1d43d-e542-4be9-93d6-9f1db372cd86 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.025056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1022/2042] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:32:42.030908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1d43d-e542-4be9-93d6-9f1db372cd86 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.041649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1d43d-e542-4be9-93d6-9f1db372cd86 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.046535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1486be-649b-4edc-bd98-62a9d0c2f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.047089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1486be-649b-4edc-bd98-62a9d0c2f4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.047374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1486be-649b-4edc-bd98-62a9d0c2f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.047645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1486be-649b-4edc-bd98-62a9d0c2f4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.048292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1486be-649b-4edc-bd98-62a9d0c2f4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.049926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1486be-649b-4edc-bd98-62a9d0c2f4d3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.067340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973a10fbc2bc4fcca77949b1d1c13bc4', 'request_id': 'req-e3d7d9b9-046b-4728-a5f7-64235310e289'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:42.074196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1023/2043] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:32:42.075621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973a10fbc2bc4fcca77949b1d1c13bc4', 'request_id': 'req-e3d7d9b9-046b-4728-a5f7-64235310e289'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:42.076588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1486be-649b-4edc-bd98-62a9d0c2f4d3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.082511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973a10fbc2bc4fcca77949b1d1c13bc4', 'request_id': 'req-e3d7d9b9-046b-4728-a5f7-64235310e289'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:42.091329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1486be-649b-4edc-bd98-62a9d0c2f4d3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.161819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e1add-e2bf-4440-9357-94bcb9e7aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.163566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e1add-e2bf-4440-9357-94bcb9e7aacf admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.164094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e1add-e2bf-4440-9357-94bcb9e7aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.164598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e1add-e2bf-4440-9357-94bcb9e7aacf admin admin] PATH_INFO: `/v3/projects/b49245f3e21b4cfd8897cf8acaf4c2ef/users/7fd01d8dd2c645bcbe001ed5aea79b71/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.192585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e1add-e2bf-4440-9357-94bcb9e7aacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49245f3e21b4cfd8897cf8acaf4c2ef, user_id=7fd01d8dd2c645bcbe001ed5aea79b71, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.196720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] The token cache is being invalidate because project 973a10fbc2bc4fcca77949b1d1c13bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:42.197301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:42.197925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e3d7d9b9-046b-4728-a5f7-64235310e289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:42.198136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e1add-e2bf-4440-9357-94bcb9e7aacf admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.200364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1021/2044] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:41 2022] DELETE /identity/v3/projects/973a10fbc2bc4fcca77949b1d1c13bc4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:42.206975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e76954-de52-401a-9662-315c0978907e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.207273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e76954-de52-401a-9662-315c0978907e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.207536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e76954-de52-401a-9662-315c0978907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.231430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-d1e76954-de52-401a-9662-315c0978907e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:42.233073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d1e76954-de52-401a-9662-315c0978907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:42.242285 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1022/2045] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:42.250907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa480f3-76a9-4e1a-bcb1-759c587491f0 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.251196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa480f3-76a9-4e1a-bcb1-759c587491f0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.251478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa480f3-76a9-4e1a-bcb1-759c587491f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.274940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-efa480f3-76a9-4e1a-bcb1-759c587491f0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:42.276088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-efa480f3-76a9-4e1a-bcb1-759c587491f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:42.284175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1023/2046] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:42.289299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa480f3-76a9-4e1a-bcb1-759c587491f0 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.294545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1024/2047] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:42 2022] PUT /identity/v3/projects/b49245f3e21b4cfd8897cf8acaf4c2ef/users/7fd01d8dd2c645bcbe001ed5aea79b71/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:42.304010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa480f3-76a9-4e1a-bcb1-759c587491f0 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.306441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dc255-8af6-42b7-801d-77e6e8eaa338 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.306750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dc255-8af6-42b7-801d-77e6e8eaa338 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.307025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dc255-8af6-42b7-801d-77e6e8eaa338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.342919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f82dc255-8af6-42b7-801d-77e6e8eaa338 None None] MFA Rules not processed for user `7fd01d8dd2c645bcbe001ed5aea79b71`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:42.344279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f82dc255-8af6-42b7-801d-77e6e8eaa338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:42.357523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:42.387260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.388018 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.388374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.388714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.389531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:42.389910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.392101 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.405702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1024/2048] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:42.411063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.423184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43dd55e-c4ae-41d6-87d8-1107dd32fb77 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.426272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1025/2049] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:42.430121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a7f27-ddbf-407a-b1a2-4ec861f18aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.430809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a7f27-ddbf-407a-b1a2-4ec861f18aba admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.431090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a7f27-ddbf-407a-b1a2-4ec861f18aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.432450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a7f27-ddbf-407a-b1a2-4ec861f18aba admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.432861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a7f27-ddbf-407a-b1a2-4ec861f18aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.434900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a7f27-ddbf-407a-b1a2-4ec861f18aba admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.441616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dc255-8af6-42b7-801d-77e6e8eaa338 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.441616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f82dc255-8af6-42b7-801d-77e6e8eaa338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:42.500807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dc255-8af6-42b7-801d-77e6e8eaa338 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.504743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b145aa-9606-4ad2-9e1f-41bc0c3d75b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.505399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b145aa-9606-4ad2-9e1f-41bc0c3d75b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.506062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b145aa-9606-4ad2-9e1f-41bc0c3d75b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.506062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b145aa-9606-4ad2-9e1f-41bc0c3d75b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.516487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b145aa-9606-4ad2-9e1f-41bc0c3d75b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.518118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b145aa-9606-4ad2-9e1f-41bc0c3d75b2 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.528433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1026/2050] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:42.540486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1025/2051] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:42 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:42.540741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b145aa-9606-4ad2-9e1f-41bc0c3d75b2 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.552118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b145aa-9606-4ad2-9e1f-41bc0c3d75b2 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.632289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b215d0-418f-4c86-a76e-8933a6e45596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.633136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b215d0-418f-4c86-a76e-8933a6e45596 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.633415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b215d0-418f-4c86-a76e-8933a6e45596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.633775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b215d0-418f-4c86-a76e-8933a6e45596 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.637125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b215d0-418f-4c86-a76e-8933a6e45596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.639577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b215d0-418f-4c86-a76e-8933a6e45596 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.750872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1027/2052] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:42 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:42.754684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a7f27-ddbf-407a-b1a2-4ec861f18aba admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.766305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a7f27-ddbf-407a-b1a2-4ec861f18aba admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.773383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d89eac-9d45-49b1-976f-c58141076a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.774184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d89eac-9d45-49b1-976f-c58141076a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.774509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d89eac-9d45-49b1-976f-c58141076a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.774883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d89eac-9d45-49b1-976f-c58141076a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.775638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d89eac-9d45-49b1-976f-c58141076a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.777395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d89eac-9d45-49b1-976f-c58141076a43 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.789656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1026/2053] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:42.796416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b215d0-418f-4c86-a76e-8933a6e45596 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.811103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b215d0-418f-4c86-a76e-8933a6e45596 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.816842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ee3a2-b853-484d-ae4e-9368dd781dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.817506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ee3a2-b853-484d-ae4e-9368dd781dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.817858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ee3a2-b853-484d-ae4e-9368dd781dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.818222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ee3a2-b853-484d-ae4e-9368dd781dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.819556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ee3a2-b853-484d-ae4e-9368dd781dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.821237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ee3a2-b853-484d-ae4e-9368dd781dfb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.833323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1028/2054] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:32:42.837754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d89eac-9d45-49b1-976f-c58141076a43 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:42.849525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d89eac-9d45-49b1-976f-c58141076a43 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:42.866465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de0a0-9bce-4346-babd-caf4114177ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:42.867162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de0a0-9bce-4346-babd-caf4114177ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.867451 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de0a0-9bce-4346-babd-caf4114177ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:42.867724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de0a0-9bce-4346-babd-caf4114177ea admin admin] PATH_INFO: `/v3/projects/cc746e07388b42adb86d1cfa10958745/users/30f1d575c1824b1a9a4e55fc3b5b9c99/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:42.888934 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de0a0-9bce-4346-babd-caf4114177ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc746e07388b42adb86d1cfa10958745, user_id=30f1d575c1824b1a9a4e55fc3b5b9c99, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:42.895571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de0a0-9bce-4346-babd-caf4114177ea admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:42.986276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1027/2055] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:42 2022] PUT /identity/v3/projects/cc746e07388b42adb86d1cfa10958745/users/30f1d575c1824b1a9a4e55fc3b5b9c99/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:42.999252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d0e6-7cd1-4c36-8985-9780440ce8f1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:42.999978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d0e6-7cd1-4c36-8985-9780440ce8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:43.000354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d0e6-7cd1-4c36-8985-9780440ce8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:43.033706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ae94d0e6-7cd1-4c36-8985-9780440ce8f1 None None] MFA Rules not processed for user `30f1d575c1824b1a9a4e55fc3b5b9c99`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:43.035153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ae94d0e6-7cd1-4c36-8985-9780440ce8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:43.059080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:43.116391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1029/2056] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:43.121707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de0a0-9bce-4346-babd-caf4114177ea admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:43.169405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:43.204549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de0a0-9bce-4346-babd-caf4114177ea admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:43.215706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d83a-7fcc-4618-8d10-fd1a71667500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:43.215706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d83a-7fcc-4618-8d10-fd1a71667500 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:43.215706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d83a-7fcc-4618-8d10-fd1a71667500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:43.215706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d83a-7fcc-4618-8d10-fd1a71667500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:43.216636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d83a-7fcc-4618-8d10-fd1a71667500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:43.218138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d83a-7fcc-4618-8d10-fd1a71667500 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:43.367670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1028/2057] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:43 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:43.371943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94d0e6-7cd1-4c36-8985-9780440ce8f1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:43.404250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94d0e6-7cd1-4c36-8985-9780440ce8f1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:43.495788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853319f-d229-45bf-914a-9d18971dd41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:43.496422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853319f-d229-45bf-914a-9d18971dd41a admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:43.496710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853319f-d229-45bf-914a-9d18971dd41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:43.497021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853319f-d229-45bf-914a-9d18971dd41a admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:43.497677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853319f-d229-45bf-914a-9d18971dd41a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:43.499789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853319f-d229-45bf-914a-9d18971dd41a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:43.613426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1030/2058] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:43 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:43.627452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d83a-7fcc-4618-8d10-fd1a71667500 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:43.635783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d83a-7fcc-4618-8d10-fd1a71667500 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:43.640926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cdec9-4cb7-4618-bbab-14d30421cec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:43.642383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cdec9-4cb7-4618-bbab-14d30421cec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:43.642383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cdec9-4cb7-4618-bbab-14d30421cec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:43.642383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cdec9-4cb7-4618-bbab-14d30421cec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:43.642833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cdec9-4cb7-4618-bbab-14d30421cec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:43.644526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cdec9-4cb7-4618-bbab-14d30421cec7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:43.656071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1029/2059] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:43.660865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853319f-d229-45bf-914a-9d18971dd41a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:43.672318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853319f-d229-45bf-914a-9d18971dd41a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:43.677337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422326f5-af43-4e88-8526-4d098f8b51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:43.678315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422326f5-af43-4e88-8526-4d098f8b51a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:43.678594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422326f5-af43-4e88-8526-4d098f8b51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:43.678921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422326f5-af43-4e88-8526-4d098f8b51a0 admin admin] PATH_INFO: `/v3/projects/c2ceab17b7374ef894c8fa3fd8a3c163/users/a998f690aad94d298807720accff40e6/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:43.697055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422326f5-af43-4e88-8526-4d098f8b51a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ceab17b7374ef894c8fa3fd8a3c163, user_id=a998f690aad94d298807720accff40e6, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:43.700175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422326f5-af43-4e88-8526-4d098f8b51a0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:43.803381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1031/2060] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:43 2022] PUT /identity/v3/projects/c2ceab17b7374ef894c8fa3fd8a3c163/users/a998f690aad94d298807720accff40e6/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:43.808206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cdec9-4cb7-4618-bbab-14d30421cec7 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:43.819887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cdec9-4cb7-4618-bbab-14d30421cec7 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:43.879477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de769d-c8f0-47c3-9cb9-3b0217bf8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:43.880258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de769d-c8f0-47c3-9cb9-3b0217bf8746 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:43.880539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de769d-c8f0-47c3-9cb9-3b0217bf8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:43.880806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de769d-c8f0-47c3-9cb9-3b0217bf8746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:43.882035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de769d-c8f0-47c3-9cb9-3b0217bf8746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:43.883630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de769d-c8f0-47c3-9cb9-3b0217bf8746 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:43.893957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1030/2061] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:43.899262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422326f5-af43-4e88-8526-4d098f8b51a0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:43.910379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422326f5-af43-4e88-8526-4d098f8b51a0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:43.915483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be56ef-e110-4f51-ac54-bbedbf5bba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:43.916147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be56ef-e110-4f51-ac54-bbedbf5bba25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:43.916426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be56ef-e110-4f51-ac54-bbedbf5bba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:43.916697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be56ef-e110-4f51-ac54-bbedbf5bba25 admin admin] PATH_INFO: `/v3/projects/c2ceab17b7374ef894c8fa3fd8a3c163/users/a998f690aad94d298807720accff40e6/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:43.918708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be56ef-e110-4f51-ac54-bbedbf5bba25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ceab17b7374ef894c8fa3fd8a3c163, user_id=a998f690aad94d298807720accff40e6, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:43.921413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be56ef-e110-4f51-ac54-bbedbf5bba25 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:43.934612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1032/2062] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:43 2022] PUT /identity/v3/projects/c2ceab17b7374ef894c8fa3fd8a3c163/users/a998f690aad94d298807720accff40e6/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:43.951665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbbae0-cf71-4d80-97eb-0fa17e42639c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:43.951975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbbae0-cf71-4d80-97eb-0fa17e42639c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:43.952256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbbae0-cf71-4d80-97eb-0fa17e42639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:43.982896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-62bbbae0-cf71-4d80-97eb-0fa17e42639c None None] MFA Rules not processed for user `a998f690aad94d298807720accff40e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:43.984184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-62bbbae0-cf71-4d80-97eb-0fa17e42639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:44.060773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1031/2063] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:44.072356 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be56ef-e110-4f51-ac54-bbedbf5bba25 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:44.135913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be56ef-e110-4f51-ac54-bbedbf5bba25 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:44.139539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0968806-9949-41d3-933c-0bef1416fba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:44.140150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968806-9949-41d3-933c-0bef1416fba6 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:44.140439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968806-9949-41d3-933c-0bef1416fba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:44.140837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968806-9949-41d3-933c-0bef1416fba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:44.151278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0968806-9949-41d3-933c-0bef1416fba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:44.152729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0968806-9949-41d3-933c-0bef1416fba6 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:44.163621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1033/2064] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:44.462677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbbae0-cf71-4d80-97eb-0fa17e42639c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:44.464282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-62bbbae0-cf71-4d80-97eb-0fa17e42639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:44.478539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbbae0-cf71-4d80-97eb-0fa17e42639c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:44.483749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:44.484792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:44.485370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:44.485820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:44.519695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:44.557748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:44.559257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:44.570633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1032/2065] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:48.185678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f767-4b32-4d09-bb3c-5952f46937e8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:48.186690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f767-4b32-4d09-bb3c-5952f46937e8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:48.188529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f767-4b32-4d09-bb3c-5952f46937e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:48.209656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-da30f767-4b32-4d09-bb3c-5952f46937e8 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:48.211044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-da30f767-4b32-4d09-bb3c-5952f46937e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:48.224579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:48.269343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1034/2066] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:48.313891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:48.315405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:48.407105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356c8fb-2823-442a-8c5e-ff58144cc2e9 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:48.413979 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac4d8-8c38-4a1a-8ee6-59e76887d8d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:48.414604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac4d8-8c38-4a1a-8ee6-59e76887d8d5 service swift] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:48.418742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac4d8-8c38-4a1a-8ee6-59e76887d8d5 service swift] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:48.418742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac4d8-8c38-4a1a-8ee6-59e76887d8d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:48.424621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ac4d8-8c38-4a1a-8ee6-59e76887d8d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:48.426246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ac4d8-8c38-4a1a-8ee6-59e76887d8d5 service swift] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:48.435941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1033/2067] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:32:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:32:49.471930 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20dccb-1600-4b0a-8b84-f82733ec15b8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:49.472586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20dccb-1600-4b0a-8b84-f82733ec15b8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:49.472586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20dccb-1600-4b0a-8b84-f82733ec15b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:49.495745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7f20dccb-1600-4b0a-8b84-f82733ec15b8 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:49.496967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7f20dccb-1600-4b0a-8b84-f82733ec15b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:49.504607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1035/2068] 10.222.0.39 () {58 vars in 967 bytes} [Mon Sep 5 12:32:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:49.520574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac4d8-8c38-4a1a-8ee6-59e76887d8d5 service swift] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:49.532290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac4d8-8c38-4a1a-8ee6-59e76887d8d5 service swift] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:49.537938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9bc6c-0b42-402e-a47a-3c908177794a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:49.538550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9bc6c-0b42-402e-a47a-3c908177794a service swift] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:49.538835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9bc6c-0b42-402e-a47a-3c908177794a service swift] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:49.539112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9bc6c-0b42-402e-a47a-3c908177794a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:49.548546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9bc6c-0b42-402e-a47a-3c908177794a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:49.550205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9bc6c-0b42-402e-a47a-3c908177794a service swift] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:49.559308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1034/2069] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:32:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:32:50.775249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97e9fb-2c5c-44ba-b37f-8b162ff2fe5b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:50.775678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97e9fb-2c5c-44ba-b37f-8b162ff2fe5b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:50.775824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97e9fb-2c5c-44ba-b37f-8b162ff2fe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:50.801514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7b97e9fb-2c5c-44ba-b37f-8b162ff2fe5b None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:50.802748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7b97e9fb-2c5c-44ba-b37f-8b162ff2fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:50.815125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1036/2070] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:32:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:50.838212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9bc6c-0b42-402e-a47a-3c908177794a service swift] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:50.851353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9bc6c-0b42-402e-a47a-3c908177794a service swift] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:50.858154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e2bb-b0e7-4c72-89c9-4b96d20f7150 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:50.863648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e2bb-b0e7-4c72-89c9-4b96d20f7150 service swift] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:50.863648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e2bb-b0e7-4c72-89c9-4b96d20f7150 service swift] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:50.863648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e2bb-b0e7-4c72-89c9-4b96d20f7150 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:50.869743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67e2bb-b0e7-4c72-89c9-4b96d20f7150 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:50.871350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67e2bb-b0e7-4c72-89c9-4b96d20f7150 service swift] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:50.883723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1035/2071] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:32:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:32:51.758808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa95c3f-347a-42ea-828f-cdf233af39f5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:51.759389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa95c3f-347a-42ea-828f-cdf233af39f5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:51.759668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa95c3f-347a-42ea-828f-cdf233af39f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:51.788700 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3aa95c3f-347a-42ea-828f-cdf233af39f5 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:51.790309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3aa95c3f-347a-42ea-828f-cdf233af39f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:51.798426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1037/2072] 10.222.0.39 () {58 vars in 967 bytes} [Mon Sep 5 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:51.812891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e2bb-b0e7-4c72-89c9-4b96d20f7150 service swift] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:51.824344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e2bb-b0e7-4c72-89c9-4b96d20f7150 service swift] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:51.837457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475387-37d4-4a43-8d16-852311db7207 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:51.838080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475387-37d4-4a43-8d16-852311db7207 service swift] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:51.838413 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475387-37d4-4a43-8d16-852311db7207 service swift] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:51.838892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475387-37d4-4a43-8d16-852311db7207 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:51.848022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a475387-37d4-4a43-8d16-852311db7207 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:51.849346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a475387-37d4-4a43-8d16-852311db7207 service swift] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:51.858514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1036/2073] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:32:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:32:54.856903 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa95c3f-347a-42ea-828f-cdf233af39f5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:54.859335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3aa95c3f-347a-42ea-828f-cdf233af39f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:54.930243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa95c3f-347a-42ea-828f-cdf233af39f5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:54.935314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:54.935947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:54.941877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:54.941877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] PATH_INFO: `/v3/users/b800d9a7d9e1452ab6f7a683b248c091` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:54.941877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b800d9a7d9e1452ab6f7a683b248c091)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:54.941877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:55.129963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b800d9a7d9e1452ab6f7a683b248c091'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.130613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b800d9a7d9e1452ab6f7a683b248c091'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.207259 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b800d9a7d9e1452ab6f7a683b248c091'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.207890 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b800d9a7d9e1452ab6f7a683b248c091'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.221346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b800d9a7d9e1452ab6f7a683b248c091'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.234281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1038/2074] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:54 2022] DELETE /identity/v3/users/b800d9a7d9e1452ab6f7a683b248c091 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:55.238808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415224f-b206-4df5-8b69-c6f9ca3df683 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:55.239296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415224f-b206-4df5-8b69-c6f9ca3df683 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:55.239509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415224f-b206-4df5-8b69-c6f9ca3df683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:55.259291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8415224f-b206-4df5-8b69-c6f9ca3df683 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:55.260314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8415224f-b206-4df5-8b69-c6f9ca3df683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:55.263630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:55.265075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:55.292356 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:55.322316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1037/2075] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:55.330496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67f64-bbea-4185-b6e3-a387e3516675 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:55.332632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415224f-b206-4df5-8b69-c6f9ca3df683 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:55.334079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8415224f-b206-4df5-8b69-c6f9ca3df683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:55.335762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:55.336910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:55.337310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:55.337499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] PATH_INFO: `/v3/users/7fd01d8dd2c645bcbe001ed5aea79b71` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:55.338832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd01d8dd2c645bcbe001ed5aea79b71)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:55.341657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:55.354809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:55.396973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415224f-b206-4df5-8b69-c6f9ca3df683 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:55.401246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:55.401886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:55.402166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:55.402429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:55.411968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:55.413479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:55.424239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1038/2076] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:32:55.570272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd01d8dd2c645bcbe001ed5aea79b71'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.572101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd01d8dd2c645bcbe001ed5aea79b71'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.630160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd01d8dd2c645bcbe001ed5aea79b71'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.630855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd01d8dd2c645bcbe001ed5aea79b71'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.638849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:55.640472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:55.657536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c0b12-bcbe-4bb0-86df-c9fbd4090be4 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:55.666803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a30928eb-4c5b-4862-a201-295b3a4b2906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd01d8dd2c645bcbe001ed5aea79b71'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.669387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:55.670049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:55.670332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:55.671045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] PATH_INFO: `/v3/projects/344feae5672b48f2b62be37c736937ce` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:55.671958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=344feae5672b48f2b62be37c736937ce)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:55.674094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:55.679474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1039/2077] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:55 2022] DELETE /identity/v3/users/7fd01d8dd2c645bcbe001ed5aea79b71 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:55.684555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e808e60-96b2-480b-b4ad-2001248eb115 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:55.684829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e808e60-96b2-480b-b4ad-2001248eb115 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:55.685148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e808e60-96b2-480b-b4ad-2001248eb115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:55.708098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0e808e60-96b2-480b-b4ad-2001248eb115 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:55.709776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0e808e60-96b2-480b-b4ad-2001248eb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:55.772911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1040/2078] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:55.785732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e808e60-96b2-480b-b4ad-2001248eb115 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:55.787502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0e808e60-96b2-480b-b4ad-2001248eb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:55.788207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344feae5672b48f2b62be37c736937ce', 'request_id': 'req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.797110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344feae5672b48f2b62be37c736937ce', 'request_id': 'req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.807277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344feae5672b48f2b62be37c736937ce', 'request_id': 'req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.860911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:55.875640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e808e60-96b2-480b-b4ad-2001248eb115 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:55.941484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:55.942038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:55.942389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:55.942834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:55.958769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] The token cache is being invalidate because project 344feae5672b48f2b62be37c736937ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:55.959069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.959724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ac1d1c4f-6cde-4a88-a13d-80807a9eec5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:55.961774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1039/2079] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:55 2022] DELETE /identity/v3/projects/344feae5672b48f2b62be37c736937ce => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:55.968295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace7b9-f7df-42c9-9dcb-eec801ea04bd None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:55.968808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace7b9-f7df-42c9-9dcb-eec801ea04bd None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:55.969245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cace7b9-f7df-42c9-9dcb-eec801ea04bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.006793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-3cace7b9-f7df-42c9-9dcb-eec801ea04bd None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:56.007907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3cace7b9-f7df-42c9-9dcb-eec801ea04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.043649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.045329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.056893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1041/2080] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:32:56.065362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.070811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.084195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1040/2081] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:56.089834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda092c-126a-4d04-8cd4-01e8a97992e2 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.092114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacabad8-b202-4f1a-bfb2-8a7aa4e6888a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.093282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacabad8-b202-4f1a-bfb2-8a7aa4e6888a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.093582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacabad8-b202-4f1a-bfb2-8a7aa4e6888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.099107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.105850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.105850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.105850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] PATH_INFO: `/v3/users/de2679145c5d4d28b774fd050f483e9f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.105850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2679145c5d4d28b774fd050f483e9f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.106330 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.118391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-eacabad8-b202-4f1a-bfb2-8a7aa4e6888a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:56.119770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-eacabad8-b202-4f1a-bfb2-8a7aa4e6888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.137863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1041/2082] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:56.137863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacabad8-b202-4f1a-bfb2-8a7aa4e6888a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.150016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacabad8-b202-4f1a-bfb2-8a7aa4e6888a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.150016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.150363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.150719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.150918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.151746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:56.151990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.153725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.172597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1042/2083] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:56.173912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.184742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a914c2c-4486-4339-a6a8-6eec2793bf3a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.189416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592181e-9aa1-4a0c-81d7-1596a339d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.190021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592181e-9aa1-4a0c-81d7-1596a339d978 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.190303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592181e-9aa1-4a0c-81d7-1596a339d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.190580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592181e-9aa1-4a0c-81d7-1596a339d978 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.191224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592181e-9aa1-4a0c-81d7-1596a339d978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.193143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592181e-9aa1-4a0c-81d7-1596a339d978 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.295356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:56.302127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1043/2084] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:56 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:56.306689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592181e-9aa1-4a0c-81d7-1596a339d978 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.380742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2679145c5d4d28b774fd050f483e9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.381915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2679145c5d4d28b774fd050f483e9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.386529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592181e-9aa1-4a0c-81d7-1596a339d978 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.391746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.392566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.393430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.393715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.394850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.396346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.482065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2679145c5d4d28b774fd050f483e9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.483584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2679145c5d4d28b774fd050f483e9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.497488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1044/2085] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:56 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:56.498506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1ef752de-7f67-4bc1-bb07-3d461eb84af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2679145c5d4d28b774fd050f483e9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.501537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.503368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.518087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e77e2-e57c-42eb-950a-86d7faefb275 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.518299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1042/2086] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:56 2022] DELETE /identity/v3/users/de2679145c5d4d28b774fd050f483e9f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:56.524202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb00b05-1101-446c-9cfa-1504738f5fd4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.524202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb00b05-1101-446c-9cfa-1504738f5fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.524483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb00b05-1101-446c-9cfa-1504738f5fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.545636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cbb00b05-1101-446c-9cfa-1504738f5fd4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:56.546982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cbb00b05-1101-446c-9cfa-1504738f5fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.560723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:56.584261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833c60-5d71-4b5c-8afc-cc7e0f01b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.584886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833c60-5d71-4b5c-8afc-cc7e0f01b6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.585200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833c60-5d71-4b5c-8afc-cc7e0f01b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.585473 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833c60-5d71-4b5c-8afc-cc7e0f01b6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.586717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833c60-5d71-4b5c-8afc-cc7e0f01b6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.588390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833c60-5d71-4b5c-8afc-cc7e0f01b6d1 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.598728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1045/2087] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:32:56.603230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833c60-5d71-4b5c-8afc-cc7e0f01b6d1 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.613670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1043/2088] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:56.622528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb00b05-1101-446c-9cfa-1504738f5fd4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.624345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cbb00b05-1101-446c-9cfa-1504738f5fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.629605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833c60-5d71-4b5c-8afc-cc7e0f01b6d1 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.636237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.636862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.637188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.637467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.638311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.641063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.654522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1046/2089] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:56.655383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.657277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb00b05-1101-446c-9cfa-1504738f5fd4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.657402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.662835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.663631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.664168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.664789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] PATH_INFO: `/v3/projects/b49245f3e21b4cfd8897cf8acaf4c2ef` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.666645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49245f3e21b4cfd8897cf8acaf4c2ef)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.668749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.723198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bdcd1-6ff8-4fa1-b52f-f571f212e181 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.728727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c92ce-9bb9-4933-862f-bbdc73a75f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.729834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c92ce-9bb9-4933-862f-bbdc73a75f6a service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.730260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c92ce-9bb9-4933-862f-bbdc73a75f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.730667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c92ce-9bb9-4933-862f-bbdc73a75f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.745741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c92ce-9bb9-4933-862f-bbdc73a75f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.747857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c92ce-9bb9-4933-862f-bbdc73a75f6a service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.760936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1047/2090] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:56.771367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c92ce-9bb9-4933-862f-bbdc73a75f6a service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:56.776420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c92ce-9bb9-4933-862f-bbdc73a75f6a service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:56.782464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49245f3e21b4cfd8897cf8acaf4c2ef', 'request_id': 'req-4f7311e2-a5de-4623-b2da-be2ac566b524'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.791384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:56.792764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49245f3e21b4cfd8897cf8acaf4c2ef', 'request_id': 'req-4f7311e2-a5de-4623-b2da-be2ac566b524'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.800114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49245f3e21b4cfd8897cf8acaf4c2ef', 'request_id': 'req-4f7311e2-a5de-4623-b2da-be2ac566b524'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.847575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6cc68-d664-42e2-805d-67d22e398836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:56.848531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6cc68-d664-42e2-805d-67d22e398836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.848916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6cc68-d664-42e2-805d-67d22e398836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.849320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6cc68-d664-42e2-805d-67d22e398836 admin admin] PATH_INFO: `/v3/projects/f02046b41a4749b3987b7a72bb3af83d/users/8b1c1310495a40da827afe14c09178b4/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.875113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6cc68-d664-42e2-805d-67d22e398836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02046b41a4749b3987b7a72bb3af83d, user_id=8b1c1310495a40da827afe14c09178b4, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:56.880082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6cc68-d664-42e2-805d-67d22e398836 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:56.910222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] The token cache is being invalidate because project b49245f3e21b4cfd8897cf8acaf4c2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:56.911135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.911263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4f7311e2-a5de-4623-b2da-be2ac566b524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:56.912786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1044/2091] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:56 2022] DELETE /identity/v3/projects/b49245f3e21b4cfd8897cf8acaf4c2ef => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:56.917776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99585-8e11-4d0a-89a3-c325c4bed5fb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.917980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99585-8e11-4d0a-89a3-c325c4bed5fb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.918311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99585-8e11-4d0a-89a3-c325c4bed5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.941299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-bce99585-8e11-4d0a-89a3-c325c4bed5fb None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:56.942516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bce99585-8e11-4d0a-89a3-c325c4bed5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.951129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1045/2092] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:56.960224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b257a8-40d9-4364-b9f7-3ff0c2e8b72f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:56.960573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b257a8-40d9-4364-b9f7-3ff0c2e8b72f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:56.960900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b257a8-40d9-4364-b9f7-3ff0c2e8b72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:56.981183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c7b257a8-40d9-4364-b9f7-3ff0c2e8b72f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:56.982440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c7b257a8-40d9-4364-b9f7-3ff0c2e8b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:56.990957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1046/2093] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:56.995808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b257a8-40d9-4364-b9f7-3ff0c2e8b72f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.005030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b257a8-40d9-4364-b9f7-3ff0c2e8b72f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.010535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.011787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.012078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.012350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.013034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:57.013343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.014949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.027486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1047/2094] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:32:57.031835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.049197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1048/2095] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:56 2022] PUT /identity/v3/projects/f02046b41a4749b3987b7a72bb3af83d/users/8b1c1310495a40da827afe14c09178b4/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:57.055808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec01c5-e437-4c73-ad31-e11af5c4399a None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.056171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec01c5-e437-4c73-ad31-e11af5c4399a None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.056523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec01c5-e437-4c73-ad31-e11af5c4399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.057733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1d62a-a264-4a6e-b052-b2d6c43e6724 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.078134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-13ec01c5-e437-4c73-ad31-e11af5c4399a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:57.079541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-13ec01c5-e437-4c73-ad31-e11af5c4399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:57.162795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0f0f1-e512-4aa8-b3ef-c4c44723f2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.163761 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0f0f1-e512-4aa8-b3ef-c4c44723f2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.164746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0f0f1-e512-4aa8-b3ef-c4c44723f2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.165276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0f0f1-e512-4aa8-b3ef-c4c44723f2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.166854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0f0f1-e512-4aa8-b3ef-c4c44723f2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.171545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0f0f1-e512-4aa8-b3ef-c4c44723f2c4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.202212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1049/2096] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:57.215447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec01c5-e437-4c73-ad31-e11af5c4399a None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.217897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-13ec01c5-e437-4c73-ad31-e11af5c4399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:57.295400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec01c5-e437-4c73-ad31-e11af5c4399a None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.301230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.302090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.302668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.303092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.307606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1048/2097] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:57 2022] POST /identity/v3/projects => generated 383 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:57.308895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0f0f1-e512-4aa8-b3ef-c4c44723f2c4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.315656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:57.321638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.322391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.332697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1050/2098] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:57.378182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0f0f1-e512-4aa8-b3ef-c4c44723f2c4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.383001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929beb29-9949-4921-8b72-bf92dd81dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.383670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929beb29-9949-4921-8b72-bf92dd81dba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.383947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929beb29-9949-4921-8b72-bf92dd81dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.384245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929beb29-9949-4921-8b72-bf92dd81dba4 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.384877 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929beb29-9949-4921-8b72-bf92dd81dba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.387227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929beb29-9949-4921-8b72-bf92dd81dba4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.437967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.439472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:57.454301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5ce1b-df4d-4b13-8118-46bc60cb8f72 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.459612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.460457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.460754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.461551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] PATH_INFO: `/v3/projects/1276d55f40944ae0850eafb2203b47ae` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.463085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1276d55f40944ae0850eafb2203b47ae)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.465327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.506519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1049/2099] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:57 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:57.507613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929beb29-9949-4921-8b72-bf92dd81dba4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.521743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929beb29-9949-4921-8b72-bf92dd81dba4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.528693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20807df-8c41-4524-a8d5-12c1dc68a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.529184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20807df-8c41-4524-a8d5-12c1dc68a3bf admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.529577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20807df-8c41-4524-a8d5-12c1dc68a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.530018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20807df-8c41-4524-a8d5-12c1dc68a3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.530661 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20807df-8c41-4524-a8d5-12c1dc68a3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.532390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20807df-8c41-4524-a8d5-12c1dc68a3bf admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.547303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1050/2100] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:57.548648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20807df-8c41-4524-a8d5-12c1dc68a3bf admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.559612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20807df-8c41-4524-a8d5-12c1dc68a3bf admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.564484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf75e8d-8d69-47e0-9a7e-0ac27cf4ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.565127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf75e8d-8d69-47e0-9a7e-0ac27cf4ce05 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.565409 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf75e8d-8d69-47e0-9a7e-0ac27cf4ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.565896 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf75e8d-8d69-47e0-9a7e-0ac27cf4ce05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.566383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf75e8d-8d69-47e0-9a7e-0ac27cf4ce05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.567957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf75e8d-8d69-47e0-9a7e-0ac27cf4ce05 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.579053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1051/2101] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:32:57.579843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:57.587839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf75e8d-8d69-47e0-9a7e-0ac27cf4ce05 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.588004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1276d55f40944ae0850eafb2203b47ae', 'request_id': 'req-d274f02e-2a09-4ae6-8d57-81778ddc060f'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:57.594230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1276d55f40944ae0850eafb2203b47ae', 'request_id': 'req-d274f02e-2a09-4ae6-8d57-81778ddc060f'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:57.598469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf75e8d-8d69-47e0-9a7e-0ac27cf4ce05 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.603342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1276d55f40944ae0850eafb2203b47ae', 'request_id': 'req-d274f02e-2a09-4ae6-8d57-81778ddc060f'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:57.664202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59fe7c-1c9d-4423-95ec-f432418f0fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.665616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59fe7c-1c9d-4423-95ec-f432418f0fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.665924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59fe7c-1c9d-4423-95ec-f432418f0fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.666203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59fe7c-1c9d-4423-95ec-f432418f0fc1 admin admin] PATH_INFO: `/v3/projects/c87e06e8008d482f9ce39b0136fb11c3/users/0adca5f96dba4aacac7746f5d751e800/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.686454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59fe7c-1c9d-4423-95ec-f432418f0fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87e06e8008d482f9ce39b0136fb11c3, user_id=0adca5f96dba4aacac7746f5d751e800, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.686784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] The token cache is being invalidate because project 1276d55f40944ae0850eafb2203b47ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:32:57.686784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:57.686784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d274f02e-2a09-4ae6-8d57-81778ddc060f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:57.687013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59fe7c-1c9d-4423-95ec-f432418f0fc1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.687100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1051/2102] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:32:57 2022] DELETE /identity/v3/projects/1276d55f40944ae0850eafb2203b47ae => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:57.690447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf93d4-ab60-4368-91ee-aa22e6dab289 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.690732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf93d4-ab60-4368-91ee-aa22e6dab289 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.691009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf93d4-ab60-4368-91ee-aa22e6dab289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.713315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-9eaf93d4-ab60-4368-91ee-aa22e6dab289 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:57.714583 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9eaf93d4-ab60-4368-91ee-aa22e6dab289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:57.722681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1052/2103] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:57.732142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0bda5-9b7b-43bf-9088-ddc24d105fb2 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.732429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0bda5-9b7b-43bf-9088-ddc24d105fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.734508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0bda5-9b7b-43bf-9088-ddc24d105fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.751797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1052/2104] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:57 2022] PUT /identity/v3/projects/c87e06e8008d482f9ce39b0136fb11c3/users/0adca5f96dba4aacac7746f5d751e800/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:32:57.753224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b8f0bda5-9b7b-43bf-9088-ddc24d105fb2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:57.754427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b8f0bda5-9b7b-43bf-9088-ddc24d105fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:57.756932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7551-a1c4-47f0-b1e8-b7ff6277c102 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.757243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7551-a1c4-47f0-b1e8-b7ff6277c102 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.757764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa7551-a1c4-47f0-b1e8-b7ff6277c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.780326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-11aa7551-a1c4-47f0-b1e8-b7ff6277c102 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:57.781590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-11aa7551-a1c4-47f0-b1e8-b7ff6277c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:57.831439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1053/2105] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:57.832769 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0bda5-9b7b-43bf-9088-ddc24d105fb2 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.843900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0bda5-9b7b-43bf-9088-ddc24d105fb2 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.849439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.850133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.850489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.850903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.852802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:32:57.852802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.853707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.864310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1053/2106] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:57.874866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa7551-a1c4-47f0-b1e8-b7ff6277c102 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.876496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-11aa7551-a1c4-47f0-b1e8-b7ff6277c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:57.877007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1054/2107] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:32:57.880728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:57.893375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39fa65-b207-40e1-9e2c-5325cac6fde8 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.899922 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa71c37-5008-4e73-8844-55fabbdbd8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.900852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa71c37-5008-4e73-8844-55fabbdbd8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.901349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa71c37-5008-4e73-8844-55fabbdbd8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.901761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa71c37-5008-4e73-8844-55fabbdbd8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.902555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa71c37-5008-4e73-8844-55fabbdbd8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.904852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa71c37-5008-4e73-8844-55fabbdbd8ea admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.950260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa7551-a1c4-47f0-b1e8-b7ff6277c102 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:57.954157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235139a-bb7b-496a-a3fa-4b1e5e0af45c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:57.954973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235139a-bb7b-496a-a3fa-4b1e5e0af45c service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:57.955465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235139a-bb7b-496a-a3fa-4b1e5e0af45c service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:57.955895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235139a-bb7b-496a-a3fa-4b1e5e0af45c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:57.966093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235139a-bb7b-496a-a3fa-4b1e5e0af45c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:57.967524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235139a-bb7b-496a-a3fa-4b1e5e0af45c service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:57.977403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1054/2108] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:58.055551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1055/2109] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:32:57 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:32:58.060265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235139a-bb7b-496a-a3fa-4b1e5e0af45c service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:58.071296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235139a-bb7b-496a-a3fa-4b1e5e0af45c service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:58.150974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02ece-5aff-478d-b76b-cef6fd9ca0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:58.151597 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02ece-5aff-478d-b76b-cef6fd9ca0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:58.151883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02ece-5aff-478d-b76b-cef6fd9ca0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:58.152162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02ece-5aff-478d-b76b-cef6fd9ca0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:58.152978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed02ece-5aff-478d-b76b-cef6fd9ca0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:58.154944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed02ece-5aff-478d-b76b-cef6fd9ca0e0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:58.249313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1055/2110] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:32:58 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:32:58.253561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa71c37-5008-4e73-8844-55fabbdbd8ea admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:58.265668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa71c37-5008-4e73-8844-55fabbdbd8ea admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:58.272663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a59067-d276-4240-95d8-ec2d107cc072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:58.273373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a59067-d276-4240-95d8-ec2d107cc072 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:58.273700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a59067-d276-4240-95d8-ec2d107cc072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:58.273974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a59067-d276-4240-95d8-ec2d107cc072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:58.274681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a59067-d276-4240-95d8-ec2d107cc072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:58.276287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a59067-d276-4240-95d8-ec2d107cc072 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:58.294726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1056/2111] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:32:58.294832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02ece-5aff-478d-b76b-cef6fd9ca0e0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:58.306384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed02ece-5aff-478d-b76b-cef6fd9ca0e0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:58.317660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d820e7-ed54-42d7-a16f-812cf16cc7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:58.318607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d820e7-ed54-42d7-a16f-812cf16cc7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:58.318893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d820e7-ed54-42d7-a16f-812cf16cc7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:58.319169 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d820e7-ed54-42d7-a16f-812cf16cc7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:58.331935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d820e7-ed54-42d7-a16f-812cf16cc7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:58.335301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d820e7-ed54-42d7-a16f-812cf16cc7b6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:58.360184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1056/2112] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:32:58.365343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a59067-d276-4240-95d8-ec2d107cc072 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:58.378500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a59067-d276-4240-95d8-ec2d107cc072 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:58.384643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:58.385346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:58.385627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:58.385955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] PATH_INFO: `/v3/projects/edefabf0d34c4f3bb1748ab09080b68a/users/446b509904364c8e8c9d0a9b0860a921/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:58.402668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edefabf0d34c4f3bb1748ab09080b68a, user_id=446b509904364c8e8c9d0a9b0860a921, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:58.406766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:58.477827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1057/2113] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:32:58 2022] PUT /identity/v3/projects/edefabf0d34c4f3bb1748ab09080b68a/users/446b509904364c8e8c9d0a9b0860a921/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:58.488503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c334b9-191b-4aec-aba4-af9aaae56ce8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:58.488797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c334b9-191b-4aec-aba4-af9aaae56ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:58.489152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c334b9-191b-4aec-aba4-af9aaae56ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:58.518892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-32c334b9-191b-4aec-aba4-af9aaae56ce8 None None] MFA Rules not processed for user `446b509904364c8e8c9d0a9b0860a921`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:58.519955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-32c334b9-191b-4aec-aba4-af9aaae56ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:58.599152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1057/2114] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:58.613856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:58.615960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:58.688888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea2594-c051-4751-ab4b-c5ded58a3af3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:58.693686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462b801-e04c-4963-8d90-4be4e74ccce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:58.694312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b801-e04c-4963-8d90-4be4e74ccce3 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:58.694595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b801-e04c-4963-8d90-4be4e74ccce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:58.694911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b801-e04c-4963-8d90-4be4e74ccce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:58.707404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462b801-e04c-4963-8d90-4be4e74ccce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:58.709612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462b801-e04c-4963-8d90-4be4e74ccce3 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:58.722138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:58.722673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1058/2115] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:32:58.772909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c334b9-191b-4aec-aba4-af9aaae56ce8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:58.905208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c334b9-191b-4aec-aba4-af9aaae56ce8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:58.911347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:58.912002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:58.912282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:58.912550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] PATH_INFO: `/v3/users/446b509904364c8e8c9d0a9b0860a921` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:58.913942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=446b509904364c8e8c9d0a9b0860a921)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:58.916539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:59.123521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446b509904364c8e8c9d0a9b0860a921'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:59.125165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446b509904364c8e8c9d0a9b0860a921'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:59.162566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:32:59.224737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446b509904364c8e8c9d0a9b0860a921'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:59.225337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446b509904364c8e8c9d0a9b0860a921'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:59.241347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446b509904364c8e8c9d0a9b0860a921'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:32:59.256031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1058/2116] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:32:58 2022] DELETE /identity/v3/users/446b509904364c8e8c9d0a9b0860a921 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:32:59.261261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e680f1-9890-4715-8b53-24180b257747 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:59.261551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e680f1-9890-4715-8b53-24180b257747 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:59.261824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e680f1-9890-4715-8b53-24180b257747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:59.283580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-39e680f1-9890-4715-8b53-24180b257747 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:59.284792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-39e680f1-9890-4715-8b53-24180b257747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:59.365144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1059/2117] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:32:59.375779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:59.377265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:59.448096 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec12c-cb49-4bdb-949f-9a88af9d13ac admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:59.452753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:59.453471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:59.453759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:59.454033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:59.466313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:59.466779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:59.488658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1059/2118] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:32:59.537250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4738b5-5fb8-440a-b9de-a1b4725a5a81 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:59.537830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4738b5-5fb8-440a-b9de-a1b4725a5a81 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:59.537830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4738b5-5fb8-440a-b9de-a1b4725a5a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:59.569749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1e4738b5-5fb8-440a-b9de-a1b4725a5a81 None None] MFA Rules not processed for user `0adca5f96dba4aacac7746f5d751e800`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:32:59.572063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1e4738b5-5fb8-440a-b9de-a1b4725a5a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:59.652077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1060/2119] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:32:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:32:59.664812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:32:59.666443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:32:59.732074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e4d02-8f51-47a5-8d10-9766dddcbbae service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:32:59.736228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fabfa-652f-45e7-9a88-1175051615f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:32:59.736846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fabfa-652f-45e7-9a88-1175051615f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:32:59.737163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fabfa-652f-45e7-9a88-1175051615f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:32:59.737444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fabfa-652f-45e7-9a88-1175051615f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:32:59.747157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fabfa-652f-45e7-9a88-1175051615f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:32:59.748609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fabfa-652f-45e7-9a88-1175051615f1 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:32:59.759136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1060/2120] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:32:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:32:59.802922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:00.605596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4738b5-5fb8-440a-b9de-a1b4725a5a81 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:00.608875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1e4738b5-5fb8-440a-b9de-a1b4725a5a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:00.629622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4738b5-5fb8-440a-b9de-a1b4725a5a81 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:00.636621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:00.637354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:00.637642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:00.637920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] PATH_INFO: `/v3/projects/edefabf0d34c4f3bb1748ab09080b68a` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:00.639689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edefabf0d34c4f3bb1748ab09080b68a)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:00.642491 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:00.774288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edefabf0d34c4f3bb1748ab09080b68a', 'request_id': 'req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:00.783466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edefabf0d34c4f3bb1748ab09080b68a', 'request_id': 'req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:00.788140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edefabf0d34c4f3bb1748ab09080b68a', 'request_id': 'req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:00.937772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] The token cache is being invalidate because project edefabf0d34c4f3bb1748ab09080b68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:00.938418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:00.939279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ebd3b6cd-1a49-4ffa-a2e4-64cfd165bed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:00.955076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1061/2121] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:00 2022] DELETE /identity/v3/projects/edefabf0d34c4f3bb1748ab09080b68a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:00.960228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a00e0-98f9-4f3e-a757-a8dc616793b2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:00.960812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a00e0-98f9-4f3e-a757-a8dc616793b2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:00.960812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a00e0-98f9-4f3e-a757-a8dc616793b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:00.987523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-507a00e0-98f9-4f3e-a757-a8dc616793b2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:00.988110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-507a00e0-98f9-4f3e-a757-a8dc616793b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:01.094141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e70f-4f4f-491f-8899-c5978e630273 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:01.094451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1061/2122] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:01.094898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e70f-4f4f-491f-8899-c5978e630273 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:01.095179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38e70f-4f4f-491f-8899-c5978e630273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:01.118910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7d38e70f-4f4f-491f-8899-c5978e630273 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:01.121230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7d38e70f-4f4f-491f-8899-c5978e630273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:01.130301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1062/2123] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:01.135153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a00e0-98f9-4f3e-a757-a8dc616793b2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:01.147124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a00e0-98f9-4f3e-a757-a8dc616793b2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:01.154315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:01.154964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:01.155514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:01.155778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:01.156478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:33:01.156792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:01.159353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:01.184111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1062/2124] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:33:01.184339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38e70f-4f4f-491f-8899-c5978e630273 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:01.194965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38e70f-4f4f-491f-8899-c5978e630273 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:01.202155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:01.205096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a61544-6ad0-430f-b11a-0239f4903057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:01.205935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a61544-6ad0-430f-b11a-0239f4903057 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:01.206432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a61544-6ad0-430f-b11a-0239f4903057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:01.206915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a61544-6ad0-430f-b11a-0239f4903057 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:01.207866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a61544-6ad0-430f-b11a-0239f4903057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:01.211074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a61544-6ad0-430f-b11a-0239f4903057 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:01.351632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1063/2125] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:01 2022] POST /identity/v3/projects => generated 391 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:33:01.359022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:01.366481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd1e30-ff92-4fc1-8d3a-e30474bde583 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:01.498916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a16df-9ccc-4613-b909-d667f4b8842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:01.499554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a16df-9ccc-4613-b909-d667f4b8842c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:01.499837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a16df-9ccc-4613-b909-d667f4b8842c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:01.500114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a16df-9ccc-4613-b909-d667f4b8842c admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:01.500933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a16df-9ccc-4613-b909-d667f4b8842c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:01.503488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a16df-9ccc-4613-b909-d667f4b8842c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:01.567884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:01.620608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1063/2126] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:01 2022] POST /identity/v3/users => generated 296 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:01.625496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a61544-6ad0-430f-b11a-0239f4903057 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:01.637075 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a61544-6ad0-430f-b11a-0239f4903057 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:01.643805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b883571-202a-4c4b-bc7c-7b09b708ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:01.644909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b883571-202a-4c4b-bc7c-7b09b708ed40 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:01.645694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b883571-202a-4c4b-bc7c-7b09b708ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:01.646125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b883571-202a-4c4b-bc7c-7b09b708ed40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:01.647256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b883571-202a-4c4b-bc7c-7b09b708ed40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:01.649164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b883571-202a-4c4b-bc7c-7b09b708ed40 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:01.665456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a16df-9ccc-4613-b909-d667f4b8842c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:01.666481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1064/2127] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:01.682119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a16df-9ccc-4613-b909-d667f4b8842c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:01.688576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11b1f0-9245-4df4-8ddf-c2bb7aa5ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:01.689508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11b1f0-9245-4df4-8ddf-c2bb7aa5ea4e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:01.689973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11b1f0-9245-4df4-8ddf-c2bb7aa5ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:01.690471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11b1f0-9245-4df4-8ddf-c2bb7aa5ea4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:01.691309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11b1f0-9245-4df4-8ddf-c2bb7aa5ea4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:01.693121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11b1f0-9245-4df4-8ddf-c2bb7aa5ea4e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:01.705443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1064/2128] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:33:01.709834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b883571-202a-4c4b-bc7c-7b09b708ed40 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:01.720380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b883571-202a-4c4b-bc7c-7b09b708ed40 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:01.727180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:01.728035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:01.728681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:01.729073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] PATH_INFO: `/v3/projects/8932fc8e8fca463d833ef320183a91fa/users/bf6ea485bb8e4196977d05b436811ffd/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:01.752166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8932fc8e8fca463d833ef320183a91fa, user_id=bf6ea485bb8e4196977d05b436811ffd, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:01.755090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:01.853396 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1065/2129] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:01 2022] PUT /identity/v3/projects/8932fc8e8fca463d833ef320183a91fa/users/bf6ea485bb8e4196977d05b436811ffd/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:01.873659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31ac07-8b93-40a9-a452-f1b56e0ad8c5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:01.873659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31ac07-8b93-40a9-a452-f1b56e0ad8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:01.873659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31ac07-8b93-40a9-a452-f1b56e0ad8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:01.905289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6b31ac07-8b93-40a9-a452-f1b56e0ad8c5 None None] MFA Rules not processed for user `bf6ea485bb8e4196977d05b436811ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:01.906611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6b31ac07-8b93-40a9-a452-f1b56e0ad8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:02.006288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1065/2130] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:02.014136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:02.016694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:02.095243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d281e-e08b-4e91-bbdc-b3f64259b10d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:02.100250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd797bf8-83e4-4007-b28b-2acea727185c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:02.100865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797bf8-83e4-4007-b28b-2acea727185c service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:02.101252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797bf8-83e4-4007-b28b-2acea727185c service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:02.102396 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd797bf8-83e4-4007-b28b-2acea727185c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:02.114649 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd797bf8-83e4-4007-b28b-2acea727185c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:02.116105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd797bf8-83e4-4007-b28b-2acea727185c service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:02.126903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1066/2131] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:02.833516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c72c-be64-4f94-85df-5a2a69c9f7f3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:02.834028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c72c-be64-4f94-85df-5a2a69c9f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:02.834812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9c72c-be64-4f94-85df-5a2a69c9f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:02.890033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2da9c72c-be64-4f94-85df-5a2a69c9f7f3 None None] MFA Rules not processed for user `0adca5f96dba4aacac7746f5d751e800`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:02.898043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2da9c72c-be64-4f94-85df-5a2a69c9f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:03.036445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1066/2132] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:03.334011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:04.518310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1ad4-a9aa-41e4-ad56-d62fbc0fbf56 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:04.519315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1ad4-a9aa-41e4-ad56-d62fbc0fbf56 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:04.519790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee1ad4-a9aa-41e4-ad56-d62fbc0fbf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:04.560205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-02ee1ad4-a9aa-41e4-ad56-d62fbc0fbf56 None None] MFA Rules not processed for user `8b1c1310495a40da827afe14c09178b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:04.561471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-02ee1ad4-a9aa-41e4-ad56-d62fbc0fbf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:04.636837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1067/2133] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:04.641939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9c72c-be64-4f94-85df-5a2a69c9f7f3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:04.644060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2da9c72c-be64-4f94-85df-5a2a69c9f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:04.728286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9c72c-be64-4f94-85df-5a2a69c9f7f3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:04.733288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e929689-b482-47fc-aac5-9fe4c51d669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:04.733914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929689-b482-47fc-aac5-9fe4c51d669b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:04.734262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929689-b482-47fc-aac5-9fe4c51d669b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:04.734704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929689-b482-47fc-aac5-9fe4c51d669b admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:04.735515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e929689-b482-47fc-aac5-9fe4c51d669b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:04.737677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e929689-b482-47fc-aac5-9fe4c51d669b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:04.963716 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1067/2134] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:04 2022] POST /identity/v3/projects => generated 371 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:04.965002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee1ad4-a9aa-41e4-ad56-d62fbc0fbf56 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:04.981511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee1ad4-a9aa-41e4-ad56-d62fbc0fbf56 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:05.027131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:05.053942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0d1c1-7f8c-42fa-bd16-2ed80b56b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:05.054567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0d1c1-7f8c-42fa-bd16-2ed80b56b9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:05.055432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0d1c1-7f8c-42fa-bd16-2ed80b56b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:05.055743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0d1c1-7f8c-42fa-bd16-2ed80b56b9c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:05.056427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0d1c1-7f8c-42fa-bd16-2ed80b56b9c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:05.058464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0d1c1-7f8c-42fa-bd16-2ed80b56b9c7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:05.203209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1068/2135] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:04 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:05.204154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e929689-b482-47fc-aac5-9fe4c51d669b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:05.216797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e929689-b482-47fc-aac5-9fe4c51d669b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:05.223519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72e1b-e32a-445e-ba9b-ca2f11d0c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:05.224623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72e1b-e32a-445e-ba9b-ca2f11d0c30c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:05.225104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72e1b-e32a-445e-ba9b-ca2f11d0c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:05.228087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72e1b-e32a-445e-ba9b-ca2f11d0c30c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:05.228087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72e1b-e32a-445e-ba9b-ca2f11d0c30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:05.228087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72e1b-e32a-445e-ba9b-ca2f11d0c30c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:05.245545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1068/2136] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:05.249846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0d1c1-7f8c-42fa-bd16-2ed80b56b9c7 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:05.265651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0d1c1-7f8c-42fa-bd16-2ed80b56b9c7 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:05.270878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354ac3-5cc8-478c-b075-c26121925b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:05.271557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354ac3-5cc8-478c-b075-c26121925b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:05.271841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354ac3-5cc8-478c-b075-c26121925b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:05.272315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354ac3-5cc8-478c-b075-c26121925b54 admin admin] PATH_INFO: `/v3/projects/3d841ef184ec452cac6058c65eb890d6/users/aad64e1ecdf44fb3bf40615cac011b8f/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:05.288353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354ac3-5cc8-478c-b075-c26121925b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d841ef184ec452cac6058c65eb890d6, user_id=aad64e1ecdf44fb3bf40615cac011b8f, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:05.291539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354ac3-5cc8-478c-b075-c26121925b54 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:05.358277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1069/2137] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:05 2022] PUT /identity/v3/projects/3d841ef184ec452cac6058c65eb890d6/users/aad64e1ecdf44fb3bf40615cac011b8f/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:05.362048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72e1b-e32a-445e-ba9b-ca2f11d0c30c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:05.381016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72e1b-e32a-445e-ba9b-ca2f11d0c30c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:05.417513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:05.438360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f05e-298e-4a7c-b023-bfb22929cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:05.439016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f05e-298e-4a7c-b023-bfb22929cb5b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:05.439302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f05e-298e-4a7c-b023-bfb22929cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:05.439575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f05e-298e-4a7c-b023-bfb22929cb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:05.440230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f05e-298e-4a7c-b023-bfb22929cb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:05.441972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f05e-298e-4a7c-b023-bfb22929cb5b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:05.453341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1069/2138] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:05.457814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354ac3-5cc8-478c-b075-c26121925b54 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:05.468449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354ac3-5cc8-478c-b075-c26121925b54 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:05.473464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:05.474343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:05.474626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:05.474944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] PATH_INFO: `/v3/projects/3d841ef184ec452cac6058c65eb890d6/users/aad64e1ecdf44fb3bf40615cac011b8f/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:05.477467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d841ef184ec452cac6058c65eb890d6, user_id=aad64e1ecdf44fb3bf40615cac011b8f, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:05.480118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:05.490582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1070/2139] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:05 2022] PUT /identity/v3/projects/3d841ef184ec452cac6058c65eb890d6/users/aad64e1ecdf44fb3bf40615cac011b8f/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:13.110789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bab9b-50b3-4479-acce-f54a4409e99f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:13.111936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bab9b-50b3-4479-acce-f54a4409e99f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:13.112520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bab9b-50b3-4479-acce-f54a4409e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:13.147847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5e8bab9b-50b3-4479-acce-f54a4409e99f None None] MFA Rules not processed for user `aad64e1ecdf44fb3bf40615cac011b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:13.150065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5e8bab9b-50b3-4479-acce-f54a4409e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:13.241398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1070/2140] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:13.255117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:13.257793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:13.352471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95885e91-74dd-4fda-868c-da29e47f8980 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:13.362862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752bbc8-9d0f-4c57-a64e-bb949fa7ab59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:13.362862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752bbc8-9d0f-4c57-a64e-bb949fa7ab59 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:13.363488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752bbc8-9d0f-4c57-a64e-bb949fa7ab59 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:13.363488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752bbc8-9d0f-4c57-a64e-bb949fa7ab59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:13.435953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752bbc8-9d0f-4c57-a64e-bb949fa7ab59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:13.438549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752bbc8-9d0f-4c57-a64e-bb949fa7ab59 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:13.448910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1071/2141] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:15.574183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bab9b-50b3-4479-acce-f54a4409e99f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:15.673804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bab9b-50b3-4479-acce-f54a4409e99f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:15.681771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:15.686316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:15.686316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:15.686316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] PATH_INFO: `/v3/users/bf6ea485bb8e4196977d05b436811ffd` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:15.686316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6ea485bb8e4196977d05b436811ffd)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:15.687152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:16.086749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6ea485bb8e4196977d05b436811ffd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:16.087535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6ea485bb8e4196977d05b436811ffd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:16.202742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6ea485bb8e4196977d05b436811ffd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:16.203967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6ea485bb8e4196977d05b436811ffd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:16.243240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:16.248892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6ea485bb8e4196977d05b436811ffd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:16.290718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1071/2142] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:33:15 2022] DELETE /identity/v3/users/bf6ea485bb8e4196977d05b436811ffd => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:16.295540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57202-60df-4240-b533-e729aa877b00 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:16.296005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57202-60df-4240-b533-e729aa877b00 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:16.296132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57202-60df-4240-b533-e729aa877b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:16.317110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-cad57202-60df-4240-b533-e729aa877b00 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:16.318752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-cad57202-60df-4240-b533-e729aa877b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:16.340826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:16.401209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1072/2143] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:16.411410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:16.412937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:16.484530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5149b4-ca5b-4315-85cc-d202b3466e49 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:16.505261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe58420-6aeb-459b-ae37-ec85cc6e27f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:16.506102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe58420-6aeb-459b-ae37-ec85cc6e27f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:16.506379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe58420-6aeb-459b-ae37-ec85cc6e27f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:16.506703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe58420-6aeb-459b-ae37-ec85cc6e27f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:16.525213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe58420-6aeb-459b-ae37-ec85cc6e27f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:16.526942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe58420-6aeb-459b-ae37-ec85cc6e27f8 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:16.540977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1072/2144] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:17.352568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57202-60df-4240-b533-e729aa877b00 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:17.355320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-cad57202-60df-4240-b533-e729aa877b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:17.374690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57202-60df-4240-b533-e729aa877b00 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:17.381302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:17.382066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:17.382509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:17.382877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] PATH_INFO: `/v3/projects/8932fc8e8fca463d833ef320183a91fa` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:17.384209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8932fc8e8fca463d833ef320183a91fa)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:17.386485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:17.581200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8932fc8e8fca463d833ef320183a91fa', 'request_id': 'req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:17.594205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8932fc8e8fca463d833ef320183a91fa', 'request_id': 'req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:17.601036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8932fc8e8fca463d833ef320183a91fa', 'request_id': 'req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:17.633168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878e8ef-70e9-4c7a-b55d-7286aa409a1e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:17.633732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878e8ef-70e9-4c7a-b55d-7286aa409a1e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:17.633969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878e8ef-70e9-4c7a-b55d-7286aa409a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:17.657685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b878e8ef-70e9-4c7a-b55d-7286aa409a1e None None] MFA Rules not processed for user `8b1c1310495a40da827afe14c09178b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:17.658974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b878e8ef-70e9-4c7a-b55d-7286aa409a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:17.690240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] The token cache is being invalidate because project 8932fc8e8fca463d833ef320183a91fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:17.690778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:17.691598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e85ea2e1-7a7e-4591-9d87-7b8346a5e045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:17.697128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1073/2145] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:17 2022] DELETE /identity/v3/projects/8932fc8e8fca463d833ef320183a91fa => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:17.700743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3296cb-8c2b-470d-8ec8-0220ba030a59 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:17.701071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3296cb-8c2b-470d-8ec8-0220ba030a59 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:17.702115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3296cb-8c2b-470d-8ec8-0220ba030a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:17.739720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4e3296cb-8c2b-470d-8ec8-0220ba030a59 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:17.741766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4e3296cb-8c2b-470d-8ec8-0220ba030a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:17.761970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1073/2146] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:17.850587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa680b5c-cb93-478f-a280-1c90f69e2a4a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:17.850885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa680b5c-cb93-478f-a280-1c90f69e2a4a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:17.851168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa680b5c-cb93-478f-a280-1c90f69e2a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:17.851484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1074/2147] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:17.883111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-aa680b5c-cb93-478f-a280-1c90f69e2a4a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:17.884326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-aa680b5c-cb93-478f-a280-1c90f69e2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:17.892577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1074/2148] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:17.897989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3296cb-8c2b-470d-8ec8-0220ba030a59 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:17.917566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3296cb-8c2b-470d-8ec8-0220ba030a59 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:17.926615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:17.927750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:17.928244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:17.928732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:17.930700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:33:17.931144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:17.932802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:17.952825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1075/2149] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:33:17.954644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa680b5c-cb93-478f-a280-1c90f69e2a4a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:17.968139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa680b5c-cb93-478f-a280-1c90f69e2a4a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:17.980658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efdd40-9322-4fec-900e-5f14710277f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:17.981577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efdd40-9322-4fec-900e-5f14710277f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:17.982067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efdd40-9322-4fec-900e-5f14710277f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:17.982521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efdd40-9322-4fec-900e-5f14710277f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:17.983389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efdd40-9322-4fec-900e-5f14710277f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:17.985487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efdd40-9322-4fec-900e-5f14710277f9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:18.161966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1075/2150] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:17 2022] POST /identity/v3/projects => generated 399 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:33:18.166625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:18.176895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571eaf1-018f-4039-add9-d36a37d45b55 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:18.251424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bacea-0450-4e0b-8967-7599e5250a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:18.252045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bacea-0450-4e0b-8967-7599e5250a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:18.252327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bacea-0450-4e0b-8967-7599e5250a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:18.253511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bacea-0450-4e0b-8967-7599e5250a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:18.253511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bacea-0450-4e0b-8967-7599e5250a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:18.255305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bacea-0450-4e0b-8967-7599e5250a9a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:18.373935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1076/2151] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:18 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:18.378597 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efdd40-9322-4fec-900e-5f14710277f9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:18.392833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efdd40-9322-4fec-900e-5f14710277f9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:18.398207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5598058-030f-4d91-8344-5a2cdebacaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:18.399636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5598058-030f-4d91-8344-5a2cdebacaaa admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:18.400197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5598058-030f-4d91-8344-5a2cdebacaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:18.400784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5598058-030f-4d91-8344-5a2cdebacaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:18.401852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5598058-030f-4d91-8344-5a2cdebacaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:18.403508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5598058-030f-4d91-8344-5a2cdebacaaa admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:18.415032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1076/2152] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:18.419370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bacea-0450-4e0b-8967-7599e5250a9a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:18.431181 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bacea-0450-4e0b-8967-7599e5250a9a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:18.440163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2dc41-a4da-42c3-a492-8baf8539e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:18.441087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2dc41-a4da-42c3-a492-8baf8539e308 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:18.441557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2dc41-a4da-42c3-a492-8baf8539e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:18.442015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2dc41-a4da-42c3-a492-8baf8539e308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:18.442896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2dc41-a4da-42c3-a492-8baf8539e308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:18.444831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2dc41-a4da-42c3-a492-8baf8539e308 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:18.463930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1077/2153] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:18.468525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5598058-030f-4d91-8344-5a2cdebacaaa admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:18.481526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5598058-030f-4d91-8344-5a2cdebacaaa admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:18.490694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:18.493332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:18.493740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:18.493947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] PATH_INFO: `/v3/projects/7ef4c9c947fd4c2e820626011dc2f5e9/users/14c08a84c4a343b9a54cb3ce00714d64/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:18.513888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef4c9c947fd4c2e820626011dc2f5e9, user_id=14c08a84c4a343b9a54cb3ce00714d64, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:18.516959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:18.632373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1077/2154] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:18 2022] PUT /identity/v3/projects/7ef4c9c947fd4c2e820626011dc2f5e9/users/14c08a84c4a343b9a54cb3ce00714d64/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:18.645411 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733257b8-73c5-48ea-af55-045a1841ffef None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:18.645617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733257b8-73c5-48ea-af55-045a1841ffef None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:18.645831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733257b8-73c5-48ea-af55-045a1841ffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:18.676690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-733257b8-73c5-48ea-af55-045a1841ffef None None] MFA Rules not processed for user `14c08a84c4a343b9a54cb3ce00714d64`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:18.677962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-733257b8-73c5-48ea-af55-045a1841ffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:18.746800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:18.758437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1078/2155] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:18.836645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:18.838603 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:18.993719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a892ea-f4a4-4948-9a26-8677d4440612 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:19.017060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908df84-8ffc-444d-b89b-4efc4c6def5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:19.018292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908df84-8ffc-444d-b89b-4efc4c6def5b service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:19.018775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908df84-8ffc-444d-b89b-4efc4c6def5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:19.019044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908df84-8ffc-444d-b89b-4efc4c6def5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:19.036416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908df84-8ffc-444d-b89b-4efc4c6def5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:19.038441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908df84-8ffc-444d-b89b-4efc4c6def5b service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:19.054211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1078/2156] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:19.625333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:25.629526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733257b8-73c5-48ea-af55-045a1841ffef None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:25.781520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733257b8-73c5-48ea-af55-045a1841ffef None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:25.793459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:25.794987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:25.795649 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:25.795932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] PATH_INFO: `/v3/users/14c08a84c4a343b9a54cb3ce00714d64` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:25.797247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c08a84c4a343b9a54cb3ce00714d64)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:25.799672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:26.086046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:26.091670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c08a84c4a343b9a54cb3ce00714d64'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:26.093389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c08a84c4a343b9a54cb3ce00714d64'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:26.260121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c08a84c4a343b9a54cb3ce00714d64'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:26.277032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c08a84c4a343b9a54cb3ce00714d64'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:26.278232 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c08a84c4a343b9a54cb3ce00714d64'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:26.316237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1079/2157] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:33:25 2022] DELETE /identity/v3/users/14c08a84c4a343b9a54cb3ce00714d64 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:26.320789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec832-a3d2-42d5-a7cd-dad2ddd209a8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:26.321325 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec832-a3d2-42d5-a7cd-dad2ddd209a8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:26.327698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ec832-a3d2-42d5-a7cd-dad2ddd209a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:26.348111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e11ec832-a3d2-42d5-a7cd-dad2ddd209a8 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:26.349731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e11ec832-a3d2-42d5-a7cd-dad2ddd209a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:26.495633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1079/2158] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:26.532511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:26.536579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:26.637380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3e60f-a50f-4a30-b868-d5964d2a1388 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:26.642191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b60e0-f381-4186-a66a-21cc1dc5551c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:26.642922 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b60e0-f381-4186-a66a-21cc1dc5551c service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:26.643264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b60e0-f381-4186-a66a-21cc1dc5551c service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:26.643601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b60e0-f381-4186-a66a-21cc1dc5551c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:26.655431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b60e0-f381-4186-a66a-21cc1dc5551c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:26.656940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b60e0-f381-4186-a66a-21cc1dc5551c service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:26.668420 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1080/2159] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:27.278784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec832-a3d2-42d5-a7cd-dad2ddd209a8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:27.280752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e11ec832-a3d2-42d5-a7cd-dad2ddd209a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:27.301000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ec832-a3d2-42d5-a7cd-dad2ddd209a8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:27.308522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:27.310200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:27.310613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:27.311405 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] PATH_INFO: `/v3/projects/7ef4c9c947fd4c2e820626011dc2f5e9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:27.312982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef4c9c947fd4c2e820626011dc2f5e9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:27.315567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:27.417463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a9b4b-5d2b-4ac1-9e11-4405740d08ab None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:27.419268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a9b4b-5d2b-4ac1-9e11-4405740d08ab None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:27.419268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a9b4b-5d2b-4ac1-9e11-4405740d08ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:27.444004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b99a9b4b-5d2b-4ac1-9e11-4405740d08ab None None] MFA Rules not processed for user `4ac91d9adcf244a6bc7de4a98c565de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:27.446159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b99a9b4b-5d2b-4ac1-9e11-4405740d08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:27.472156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef4c9c947fd4c2e820626011dc2f5e9', 'request_id': 'req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:27.485512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef4c9c947fd4c2e820626011dc2f5e9', 'request_id': 'req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:27.497103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef4c9c947fd4c2e820626011dc2f5e9', 'request_id': 'req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:27.527596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1081/2160] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:27.576349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] The token cache is being invalidate because project 7ef4c9c947fd4c2e820626011dc2f5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:27.580530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:27.580530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a24cae1b-16e6-46a6-ba14-423fbbfa0eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:27.580530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1080/2161] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:27 2022] DELETE /identity/v3/projects/7ef4c9c947fd4c2e820626011dc2f5e9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:33:30.104554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a9b4b-5d2b-4ac1-9e11-4405740d08ab None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:30.106142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b99a9b4b-5d2b-4ac1-9e11-4405740d08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:30.120885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a9b4b-5d2b-4ac1-9e11-4405740d08ab None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:30.190001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:30.196591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:30.196591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:30.196591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] PATH_INFO: `/v3/users/30f1d575c1824b1a9a4e55fc3b5b9c99` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:30.199351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f1d575c1824b1a9a4e55fc3b5b9c99)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:30.202864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:30.224733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:30.378990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f1d575c1824b1a9a4e55fc3b5b9c99'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:30.379772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f1d575c1824b1a9a4e55fc3b5b9c99'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:30.470644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f1d575c1824b1a9a4e55fc3b5b9c99'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:30.485007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f1d575c1824b1a9a4e55fc3b5b9c99'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:30.485646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f1d575c1824b1a9a4e55fc3b5b9c99'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:30.500354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1082/2162] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:33:30 2022] DELETE /identity/v3/users/30f1d575c1824b1a9a4e55fc3b5b9c99 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:30.505176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89383112-ba65-4a2e-a153-131c496e2e5d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:30.505702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89383112-ba65-4a2e-a153-131c496e2e5d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:30.505795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89383112-ba65-4a2e-a153-131c496e2e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:30.525709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-89383112-ba65-4a2e-a153-131c496e2e5d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:30.526969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-89383112-ba65-4a2e-a153-131c496e2e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:30.600753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:30.614299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1081/2163] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:30.624236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:30.626967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:30.713827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb4894-128c-4f75-aaeb-072279804eaf admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:30.720546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15982540-d2e1-4e58-9468-89e057c35fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:30.720546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15982540-d2e1-4e58-9468-89e057c35fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:30.720546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15982540-d2e1-4e58-9468-89e057c35fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:30.720975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15982540-d2e1-4e58-9468-89e057c35fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:30.735751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15982540-d2e1-4e58-9468-89e057c35fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:30.737332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15982540-d2e1-4e58-9468-89e057c35fb6 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:30.750116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1083/2164] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:31.802957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89383112-ba65-4a2e-a153-131c496e2e5d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:31.805462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-89383112-ba65-4a2e-a153-131c496e2e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:31.820485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89383112-ba65-4a2e-a153-131c496e2e5d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:31.832238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:31.832909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:31.833258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:31.833523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] PATH_INFO: `/v3/projects/cc746e07388b42adb86d1cfa10958745` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:31.835449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc746e07388b42adb86d1cfa10958745)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:31.844840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:32.027924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc746e07388b42adb86d1cfa10958745', 'request_id': 'req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.041936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc746e07388b42adb86d1cfa10958745', 'request_id': 'req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.052547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc746e07388b42adb86d1cfa10958745', 'request_id': 'req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.192140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] The token cache is being invalidate because project cc746e07388b42adb86d1cfa10958745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:32.192504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.193343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.195470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1082/2165] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:31 2022] DELETE /identity/v3/projects/cc746e07388b42adb86d1cfa10958745 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:32.201748 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15982540-d2e1-4e58-9468-89e057c35fb6 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:32.215450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15982540-d2e1-4e58-9468-89e057c35fb6 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:32.282365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:32.282955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:32.283235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:32.283513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] PATH_INFO: `/v3/users/a998f690aad94d298807720accff40e6` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:32.284852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a998f690aad94d298807720accff40e6)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:32.286876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:32.497525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:32.508451 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a998f690aad94d298807720accff40e6'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.509208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a998f690aad94d298807720accff40e6'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.590931 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a998f690aad94d298807720accff40e6'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.611127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a998f690aad94d298807720accff40e6'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.611956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b1175634-eef3-464f-bc14-922f98cc5f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a998f690aad94d298807720accff40e6'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:32.625327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1084/2166] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:33:32 2022] DELETE /identity/v3/users/a998f690aad94d298807720accff40e6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:33.116383 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:33.119183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:33.153946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497b9f-cfcd-4b7f-bc74-504f7ff1ac4b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:33.226887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:33.227287 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:33.227575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:33.228003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] PATH_INFO: `/v3/projects/c2ceab17b7374ef894c8fa3fd8a3c163` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:33.229449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ceab17b7374ef894c8fa3fd8a3c163)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:33.231679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:33.375328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ceab17b7374ef894c8fa3fd8a3c163', 'request_id': 'req-ee05923e-b9d2-4aad-b73d-81277205f4fc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:33.382846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ceab17b7374ef894c8fa3fd8a3c163', 'request_id': 'req-ee05923e-b9d2-4aad-b73d-81277205f4fc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:33.389966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ceab17b7374ef894c8fa3fd8a3c163', 'request_id': 'req-ee05923e-b9d2-4aad-b73d-81277205f4fc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:33.454373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] The token cache is being invalidate because project c2ceab17b7374ef894c8fa3fd8a3c163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:33.454659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:33.455411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ee05923e-b9d2-4aad-b73d-81277205f4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:33.456993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1083/2167] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:33 2022] DELETE /identity/v3/projects/c2ceab17b7374ef894c8fa3fd8a3c163 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:33:33.462604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303f46-940e-4e18-a20e-9db21af30310 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:33.463305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303f46-940e-4e18-a20e-9db21af30310 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:33.463305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28303f46-940e-4e18-a20e-9db21af30310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:33.485395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-28303f46-940e-4e18-a20e-9db21af30310 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:33.487870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-28303f46-940e-4e18-a20e-9db21af30310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:33.552187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1085/2168] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:33.560783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11f8b-98d8-4f47-8585-3dcd22074f75 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:33.561269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11f8b-98d8-4f47-8585-3dcd22074f75 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:33.561619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e11f8b-98d8-4f47-8585-3dcd22074f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:33.589047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f2e11f8b-98d8-4f47-8585-3dcd22074f75 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:33.589840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f2e11f8b-98d8-4f47-8585-3dcd22074f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:33.599333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1084/2169] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:33.604429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28303f46-940e-4e18-a20e-9db21af30310 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:33.614805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28303f46-940e-4e18-a20e-9db21af30310 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:33.619830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:33.620441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:33.620723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:33.621106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:33.621779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:33:33.622084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:33.628707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:33.638129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1086/2170] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:33:33.642842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e11f8b-98d8-4f47-8585-3dcd22074f75 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:33.647438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:33.654250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e11f8b-98d8-4f47-8585-3dcd22074f75 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:33.659256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60084d-9b33-4345-89bb-b3fa9839e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:33.659879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60084d-9b33-4345-89bb-b3fa9839e983 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:33.660161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60084d-9b33-4345-89bb-b3fa9839e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:33.660438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60084d-9b33-4345-89bb-b3fa9839e983 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:33.661136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60084d-9b33-4345-89bb-b3fa9839e983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:33.663095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60084d-9b33-4345-89bb-b3fa9839e983 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:33.769556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1085/2171] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:33 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:33.774471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:33.787514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d940e3-3a01-4792-a8d1-3ca560727811 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:33.893702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397614ea-4076-4d1a-a2ce-fb1fbe79915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:33.896993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397614ea-4076-4d1a-a2ce-fb1fbe79915f admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:33.896993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397614ea-4076-4d1a-a2ce-fb1fbe79915f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:33.896993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397614ea-4076-4d1a-a2ce-fb1fbe79915f admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:33.896993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397614ea-4076-4d1a-a2ce-fb1fbe79915f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:33.898044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397614ea-4076-4d1a-a2ce-fb1fbe79915f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:34.089936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1087/2172] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:33 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:34.095723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60084d-9b33-4345-89bb-b3fa9839e983 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:34.110288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60084d-9b33-4345-89bb-b3fa9839e983 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:34.121464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076347-9663-47b6-a62d-43e83c6d26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:34.122683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076347-9663-47b6-a62d-43e83c6d26be admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:34.123172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076347-9663-47b6-a62d-43e83c6d26be admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:34.123828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076347-9663-47b6-a62d-43e83c6d26be admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:34.124590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8076347-9663-47b6-a62d-43e83c6d26be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:34.127206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8076347-9663-47b6-a62d-43e83c6d26be admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:34.139142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1086/2173] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:34.143831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397614ea-4076-4d1a-a2ce-fb1fbe79915f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:34.156719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397614ea-4076-4d1a-a2ce-fb1fbe79915f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:34.165181 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32afac-d24e-46b6-8324-889a870f535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:34.166164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32afac-d24e-46b6-8324-889a870f535a admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:34.166552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32afac-d24e-46b6-8324-889a870f535a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:34.166984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32afac-d24e-46b6-8324-889a870f535a admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:34.168002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32afac-d24e-46b6-8324-889a870f535a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:34.169836 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32afac-d24e-46b6-8324-889a870f535a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:34.182417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1088/2174] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:33:34.187065 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076347-9663-47b6-a62d-43e83c6d26be admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:34.198092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076347-9663-47b6-a62d-43e83c6d26be admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:34.204230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ce0c5-0237-4590-bc4e-ba4d61010697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:34.208191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce0c5-0237-4590-bc4e-ba4d61010697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:34.208191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce0c5-0237-4590-bc4e-ba4d61010697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:34.208191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce0c5-0237-4590-bc4e-ba4d61010697 admin admin] PATH_INFO: `/v3/projects/d508182d5a404fa29b633bdf6aaefe77/users/58ab73c6d5ca444ba3c097e5b4034d61/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:34.228544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ce0c5-0237-4590-bc4e-ba4d61010697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d508182d5a404fa29b633bdf6aaefe77, user_id=58ab73c6d5ca444ba3c097e5b4034d61, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:34.235334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ce0c5-0237-4590-bc4e-ba4d61010697 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:34.329052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1087/2175] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:34 2022] PUT /identity/v3/projects/d508182d5a404fa29b633bdf6aaefe77/users/58ab73c6d5ca444ba3c097e5b4034d61/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:34.343753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64380a99-27aa-453d-a98f-cbcac64cf1ca None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:34.344456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64380a99-27aa-453d-a98f-cbcac64cf1ca None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:34.344978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64380a99-27aa-453d-a98f-cbcac64cf1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:34.393525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-64380a99-27aa-453d-a98f-cbcac64cf1ca None None] MFA Rules not processed for user `58ab73c6d5ca444ba3c097e5b4034d61`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:34.395351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-64380a99-27aa-453d-a98f-cbcac64cf1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:34.403636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:34.518605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ce0c5-0237-4590-bc4e-ba4d61010697 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:34.528076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1089/2176] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:34.620251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ce0c5-0237-4590-bc4e-ba4d61010697 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:34.629923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebab8ab-d235-4b78-9bd7-32e7111c871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:34.634567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebab8ab-d235-4b78-9bd7-32e7111c871f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:34.634567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebab8ab-d235-4b78-9bd7-32e7111c871f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:34.634567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebab8ab-d235-4b78-9bd7-32e7111c871f admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:34.634567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebab8ab-d235-4b78-9bd7-32e7111c871f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:34.638931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebab8ab-d235-4b78-9bd7-32e7111c871f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:34.766044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1088/2177] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:34 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:34.768081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64380a99-27aa-453d-a98f-cbcac64cf1ca None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:34.781873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64380a99-27aa-453d-a98f-cbcac64cf1ca None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:34.859079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98076576-73c5-4c7e-aa83-baf8f2a6d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:34.860103 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98076576-73c5-4c7e-aa83-baf8f2a6d01a admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:34.860474 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98076576-73c5-4c7e-aa83-baf8f2a6d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:34.860810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98076576-73c5-4c7e-aa83-baf8f2a6d01a admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:34.861581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98076576-73c5-4c7e-aa83-baf8f2a6d01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:34.864904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98076576-73c5-4c7e-aa83-baf8f2a6d01a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:35.020621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1090/2178] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:34 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:33:35.026451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebab8ab-d235-4b78-9bd7-32e7111c871f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:35.047868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebab8ab-d235-4b78-9bd7-32e7111c871f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:35.057318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625a847-a2f4-49c9-bae4-7726a2801c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:35.057952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a847-a2f4-49c9-bae4-7726a2801c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:35.058235 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a847-a2f4-49c9-bae4-7726a2801c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:35.058506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625a847-a2f4-49c9-bae4-7726a2801c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:35.059174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625a847-a2f4-49c9-bae4-7726a2801c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:35.061155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625a847-a2f4-49c9-bae4-7726a2801c1c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:35.074527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1089/2179] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:35.080438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98076576-73c5-4c7e-aa83-baf8f2a6d01a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:35.101566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98076576-73c5-4c7e-aa83-baf8f2a6d01a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:35.112379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1515c-7153-402f-bca5-c670a2ab17ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:35.113186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1515c-7153-402f-bca5-c670a2ab17ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:35.113712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1515c-7153-402f-bca5-c670a2ab17ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:35.116158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1515c-7153-402f-bca5-c670a2ab17ea admin admin] PATH_INFO: `/v3/projects/5f5dd05f61e8466492a644069337b1d7/users/e35ee2894a624dada34bf434280ddd4d/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:35.149230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1515c-7153-402f-bca5-c670a2ab17ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5dd05f61e8466492a644069337b1d7, user_id=e35ee2894a624dada34bf434280ddd4d, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:35.154777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1515c-7153-402f-bca5-c670a2ab17ea admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:35.282718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1091/2180] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:35 2022] PUT /identity/v3/projects/5f5dd05f61e8466492a644069337b1d7/users/e35ee2894a624dada34bf434280ddd4d/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:35.292324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625a847-a2f4-49c9-bae4-7726a2801c1c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:35.303375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625a847-a2f4-49c9-bae4-7726a2801c1c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:35.379190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff30dc-ddf0-4433-86ed-af308280dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:35.379850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff30dc-ddf0-4433-86ed-af308280dcef admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:35.380136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff30dc-ddf0-4433-86ed-af308280dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:35.380415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff30dc-ddf0-4433-86ed-af308280dcef admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:35.381138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff30dc-ddf0-4433-86ed-af308280dcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:35.382970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff30dc-ddf0-4433-86ed-af308280dcef admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:35.402170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1090/2181] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:35.407511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1515c-7153-402f-bca5-c670a2ab17ea admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:35.430693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1515c-7153-402f-bca5-c670a2ab17ea admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:35.440992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07bf8f-66d9-4596-97ba-10c6bd4684b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:35.442129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07bf8f-66d9-4596-97ba-10c6bd4684b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:35.442625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07bf8f-66d9-4596-97ba-10c6bd4684b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:35.443106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07bf8f-66d9-4596-97ba-10c6bd4684b9 admin admin] PATH_INFO: `/v3/projects/5f5dd05f61e8466492a644069337b1d7/users/e35ee2894a624dada34bf434280ddd4d/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:35.448711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07bf8f-66d9-4596-97ba-10c6bd4684b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5dd05f61e8466492a644069337b1d7, user_id=e35ee2894a624dada34bf434280ddd4d, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:35.454646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07bf8f-66d9-4596-97ba-10c6bd4684b9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:35.478777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1092/2182] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:35 2022] PUT /identity/v3/projects/5f5dd05f61e8466492a644069337b1d7/users/e35ee2894a624dada34bf434280ddd4d/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:35.494804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260016a-495c-47be-82c4-daecc93cb65a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:35.495507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260016a-495c-47be-82c4-daecc93cb65a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:35.496240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260016a-495c-47be-82c4-daecc93cb65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:35.539462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1260016a-495c-47be-82c4-daecc93cb65a None None] MFA Rules not processed for user `e35ee2894a624dada34bf434280ddd4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:35.540753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1260016a-495c-47be-82c4-daecc93cb65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:35.545151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:35.569337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370cc28-9bab-4782-920a-900ea3af4bcb None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:35.570167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370cc28-9bab-4782-920a-900ea3af4bcb None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:35.570167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370cc28-9bab-4782-920a-900ea3af4bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:35.591610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b370cc28-9bab-4782-920a-900ea3af4bcb None None] MFA Rules not processed for user `567ad9bf5078478a9ef462229bf7f930`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:35.593484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b370cc28-9bab-4782-920a-900ea3af4bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:35.638856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1091/2183] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:35.647258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260016a-495c-47be-82c4-daecc93cb65a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:35.649263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1260016a-495c-47be-82c4-daecc93cb65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:35.660896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1093/2184] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:35.730591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260016a-495c-47be-82c4-daecc93cb65a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:35.737659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:35.738757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:35.739320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:35.739806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:35.772060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:35.775250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:35.798054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1092/2185] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:33:39.667888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b65d5-1dd7-454a-97f3-61cbd1acdf33 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:39.668482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b65d5-1dd7-454a-97f3-61cbd1acdf33 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:39.668586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b65d5-1dd7-454a-97f3-61cbd1acdf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:39.693003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:39.718969 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-829b65d5-1dd7-454a-97f3-61cbd1acdf33 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:39.720487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-829b65d5-1dd7-454a-97f3-61cbd1acdf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:39.890246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1094/2186] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:39.908941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:39.910871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:40.039719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb186c06-fa49-4fe0-a89b-55de908b1653 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:40.046096 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9e343-140d-4d3a-8170-6649cb3a0c02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:40.047544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9e343-140d-4d3a-8170-6649cb3a0c02 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:40.047851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9e343-140d-4d3a-8170-6649cb3a0c02 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:40.048128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9e343-140d-4d3a-8170-6649cb3a0c02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:40.062327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9e343-140d-4d3a-8170-6649cb3a0c02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:40.064707 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9e343-140d-4d3a-8170-6649cb3a0c02 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:40.075687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1093/2187] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:33:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:33:40.115421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b65d5-1dd7-454a-97f3-61cbd1acdf33 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:40.214998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b65d5-1dd7-454a-97f3-61cbd1acdf33 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:40.229493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:40.230119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:40.230486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:40.230767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] PATH_INFO: `/v3/users/58ab73c6d5ca444ba3c097e5b4034d61` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:40.233706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ab73c6d5ca444ba3c097e5b4034d61)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:40.236067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:40.493008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ab73c6d5ca444ba3c097e5b4034d61'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:40.493569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ab73c6d5ca444ba3c097e5b4034d61'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:40.612332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ab73c6d5ca444ba3c097e5b4034d61'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:40.646310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ab73c6d5ca444ba3c097e5b4034d61'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:40.647282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ab73c6d5ca444ba3c097e5b4034d61'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:40.664994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1095/2188] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:33:40 2022] DELETE /identity/v3/users/58ab73c6d5ca444ba3c097e5b4034d61 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:40.669617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45a73-1f5a-40f7-89c1-7adfebbf38cc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:40.669898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45a73-1f5a-40f7-89c1-7adfebbf38cc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:40.670450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45a73-1f5a-40f7-89c1-7adfebbf38cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:40.692420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f5b45a73-1f5a-40f7-89c1-7adfebbf38cc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:40.695719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f5b45a73-1f5a-40f7-89c1-7adfebbf38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:40.751362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:40.864217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1094/2189] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:40.877025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:40.879076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:40.982945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:41.046923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103c614-b8b1-4809-b551-2b85c2679c0e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:41.055400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af2ef0-2933-4656-b757-32b8b5878ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:41.056045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2ef0-2933-4656-b757-32b8b5878ada service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:41.056328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2ef0-2933-4656-b757-32b8b5878ada service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:41.056603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af2ef0-2933-4656-b757-32b8b5878ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:41.067104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af2ef0-2933-4656-b757-32b8b5878ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:41.068564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af2ef0-2933-4656-b757-32b8b5878ada service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:41.087458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1096/2190] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:42.261107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b45a73-1f5a-40f7-89c1-7adfebbf38cc None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:42.263833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f5b45a73-1f5a-40f7-89c1-7adfebbf38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:42.289857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b45a73-1f5a-40f7-89c1-7adfebbf38cc None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:42.303825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:42.305589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:42.306413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:42.307163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] PATH_INFO: `/v3/projects/d508182d5a404fa29b633bdf6aaefe77` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:42.313828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d508182d5a404fa29b633bdf6aaefe77)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:42.316668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:42.646629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd508182d5a404fa29b633bdf6aaefe77', 'request_id': 'req-e78ef118-eb53-404e-b736-09066fd289c9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:42.671611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd508182d5a404fa29b633bdf6aaefe77', 'request_id': 'req-e78ef118-eb53-404e-b736-09066fd289c9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:42.690842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd508182d5a404fa29b633bdf6aaefe77', 'request_id': 'req-e78ef118-eb53-404e-b736-09066fd289c9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:42.787757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] The token cache is being invalidate because project d508182d5a404fa29b633bdf6aaefe77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:42.788357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:42.790840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:42.794833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1095/2191] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:42 2022] DELETE /identity/v3/projects/d508182d5a404fa29b633bdf6aaefe77 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:42.803418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af2ef0-2933-4656-b757-32b8b5878ada service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:42.819602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af2ef0-2933-4656-b757-32b8b5878ada service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:42.975053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:42.976873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:42.977928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:42.978964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] PATH_INFO: `/v3/users/e35ee2894a624dada34bf434280ddd4d` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:42.981073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35ee2894a624dada34bf434280ddd4d)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:42.985391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:43.323817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35ee2894a624dada34bf434280ddd4d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:43.324485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35ee2894a624dada34bf434280ddd4d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:43.438452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35ee2894a624dada34bf434280ddd4d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:43.461825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35ee2894a624dada34bf434280ddd4d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:43.462591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f772d091-c10e-47c0-81c8-a34a76be9ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35ee2894a624dada34bf434280ddd4d'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:43.500451 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1097/2192] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:33:42 2022] DELETE /identity/v3/users/e35ee2894a624dada34bf434280ddd4d => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:44.794265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:44.797018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:44.815792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ef118-eb53-404e-b736-09066fd289c9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:44.944401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:44.949558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:44.949558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:44.949558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] PATH_INFO: `/v3/projects/5f5dd05f61e8466492a644069337b1d7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:44.949558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5dd05f61e8466492a644069337b1d7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:44.952384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:45.103245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5dd05f61e8466492a644069337b1d7', 'request_id': 'req-95e1d9f7-c45d-4288-bb07-d72a476cc919'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:45.142271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5dd05f61e8466492a644069337b1d7', 'request_id': 'req-95e1d9f7-c45d-4288-bb07-d72a476cc919'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:45.155152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:45.170152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5dd05f61e8466492a644069337b1d7', 'request_id': 'req-95e1d9f7-c45d-4288-bb07-d72a476cc919'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:45.298239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] The token cache is being invalidate because project 5f5dd05f61e8466492a644069337b1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:45.298633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:45.299944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95e1d9f7-c45d-4288-bb07-d72a476cc919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:45.306303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1096/2193] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:44 2022] DELETE /identity/v3/projects/5f5dd05f61e8466492a644069337b1d7 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:45.309386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd58b6-465f-45c7-881c-23380fc63028 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:45.309386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd58b6-465f-45c7-881c-23380fc63028 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:45.311145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd58b6-465f-45c7-881c-23380fc63028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:45.345575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c7dd58b6-465f-45c7-881c-23380fc63028 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:45.346841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c7dd58b6-465f-45c7-881c-23380fc63028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:45.477849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:45.532184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1098/2194] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:45.541520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff509e1-d1a2-4146-abd5-e02339a25ad1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:45.541901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff509e1-d1a2-4146-abd5-e02339a25ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:45.542178 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff509e1-d1a2-4146-abd5-e02339a25ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:45.575353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8ff509e1-d1a2-4146-abd5-e02339a25ad1 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:45.576827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8ff509e1-d1a2-4146-abd5-e02339a25ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:45.587231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1097/2195] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:45.591683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd58b6-465f-45c7-881c-23380fc63028 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:45.626368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd58b6-465f-45c7-881c-23380fc63028 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:45.646608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:45.647518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:45.653824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:45.653824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:45.653824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:33:45.653824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:45.653824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:45.688665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1099/2196] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:33:45.689521 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff509e1-d1a2-4146-abd5-e02339a25ad1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:45.700801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff509e1-d1a2-4146-abd5-e02339a25ad1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:45.710183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6245f8a-2587-4730-9651-0459373447c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:45.710970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245f8a-2587-4730-9651-0459373447c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:45.711825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245f8a-2587-4730-9651-0459373447c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:45.712257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245f8a-2587-4730-9651-0459373447c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:45.713539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6245f8a-2587-4730-9651-0459373447c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:45.716908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6245f8a-2587-4730-9651-0459373447c3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:45.942491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1098/2197] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:45 2022] POST /identity/v3/projects => generated 367 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:45.944754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:45.960015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bf4c7-e585-48db-8008-9bced21a5d42 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:46.101924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff50f0-ef20-4993-8f23-9a16d39afe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:46.105722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff50f0-ef20-4993-8f23-9a16d39afe62 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:46.105722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff50f0-ef20-4993-8f23-9a16d39afe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:46.105722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff50f0-ef20-4993-8f23-9a16d39afe62 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:46.105722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff50f0-ef20-4993-8f23-9a16d39afe62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:46.107610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff50f0-ef20-4993-8f23-9a16d39afe62 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:46.200352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1100/2198] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:45 2022] POST /identity/v3/users => generated 284 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:46.204670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6245f8a-2587-4730-9651-0459373447c3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:46.229513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6245f8a-2587-4730-9651-0459373447c3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:46.252500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd0b9-640a-4a1c-9a6a-3ca117633998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:46.252500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd0b9-640a-4a1c-9a6a-3ca117633998 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:46.252500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd0b9-640a-4a1c-9a6a-3ca117633998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:46.252500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd0b9-640a-4a1c-9a6a-3ca117633998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:46.252870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cd0b9-640a-4a1c-9a6a-3ca117633998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:46.252870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cd0b9-640a-4a1c-9a6a-3ca117633998 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:46.271994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1099/2199] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:46.273552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff50f0-ef20-4993-8f23-9a16d39afe62 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:46.291788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff50f0-ef20-4993-8f23-9a16d39afe62 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:46.300686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8974-e52f-4895-bc22-f402e3eb37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:46.301454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8974-e52f-4895-bc22-f402e3eb37be admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:46.301840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8974-e52f-4895-bc22-f402e3eb37be admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:46.302368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8974-e52f-4895-bc22-f402e3eb37be admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:46.303985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8974-e52f-4895-bc22-f402e3eb37be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:46.306681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8974-e52f-4895-bc22-f402e3eb37be admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:46.325920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd0b9-640a-4a1c-9a6a-3ca117633998 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:46.358355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1101/2200] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:46.367594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd0b9-640a-4a1c-9a6a-3ca117633998 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:46.400371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a883eb-ca2c-4b7e-ac76-423c272cf6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:46.401639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a883eb-ca2c-4b7e-ac76-423c272cf6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:46.403789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a883eb-ca2c-4b7e-ac76-423c272cf6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:46.405457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a883eb-ca2c-4b7e-ac76-423c272cf6ad admin admin] PATH_INFO: `/v3/projects/79e8960af316486fac8591fdab033474/users/5cebd5f4c6614b23b616e7a8cef5d3a2/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:46.451273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a883eb-ca2c-4b7e-ac76-423c272cf6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e8960af316486fac8591fdab033474, user_id=5cebd5f4c6614b23b616e7a8cef5d3a2, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:46.455696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a883eb-ca2c-4b7e-ac76-423c272cf6ad admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:46.564388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1100/2201] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:46 2022] PUT /identity/v3/projects/79e8960af316486fac8591fdab033474/users/5cebd5f4c6614b23b616e7a8cef5d3a2/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:46.576482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e66a-b389-46fc-acbb-de0e860e74c8 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:46.576749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e66a-b389-46fc-acbb-de0e860e74c8 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:46.576998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7e66a-b389-46fc-acbb-de0e860e74c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:46.663342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-97d7e66a-b389-46fc-acbb-de0e860e74c8 None None] MFA Rules not processed for user `5cebd5f4c6614b23b616e7a8cef5d3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:46.665880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-97d7e66a-b389-46fc-acbb-de0e860e74c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:46.876551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1102/2202] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:46.880419 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a883eb-ca2c-4b7e-ac76-423c272cf6ad admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:46.985480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a883eb-ca2c-4b7e-ac76-423c272cf6ad admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:46.990512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ada4-a6d0-4194-807e-59e57706dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:46.991050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ada4-a6d0-4194-807e-59e57706dc48 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:46.991335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ada4-a6d0-4194-807e-59e57706dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:46.992147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ada4-a6d0-4194-807e-59e57706dc48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:46.993053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ada4-a6d0-4194-807e-59e57706dc48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:46.997288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ada4-a6d0-4194-807e-59e57706dc48 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:47.137061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1101/2203] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:46 2022] POST /identity/v3/projects => generated 369 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:33:47.138198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7e66a-b389-46fc-acbb-de0e860e74c8 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:47.155437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7e66a-b389-46fc-acbb-de0e860e74c8 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:47.272894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:47.295941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecfa14-5419-4182-ae17-245014bb6e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:47.296629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecfa14-5419-4182-ae17-245014bb6e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:47.296976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecfa14-5419-4182-ae17-245014bb6e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:47.299823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecfa14-5419-4182-ae17-245014bb6e5a admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:47.299823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecfa14-5419-4182-ae17-245014bb6e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:47.300285 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cecfa14-5419-4182-ae17-245014bb6e5a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:47.426098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1103/2204] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:47 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:47.428736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ada4-a6d0-4194-807e-59e57706dc48 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:47.448753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ada4-a6d0-4194-807e-59e57706dc48 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:47.456208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631177a4-d054-4d1e-b531-ec425ab79059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:47.457171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631177a4-d054-4d1e-b531-ec425ab79059 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:47.457751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631177a4-d054-4d1e-b531-ec425ab79059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:47.459840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631177a4-d054-4d1e-b531-ec425ab79059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:47.461135 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631177a4-d054-4d1e-b531-ec425ab79059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:47.463901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631177a4-d054-4d1e-b531-ec425ab79059 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:47.487980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1102/2205] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:47.492598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecfa14-5419-4182-ae17-245014bb6e5a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:47.519540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecfa14-5419-4182-ae17-245014bb6e5a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:47.567409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab213ceb-a3d0-4972-b884-1c607ae47fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:47.570218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab213ceb-a3d0-4972-b884-1c607ae47fad admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:47.571264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab213ceb-a3d0-4972-b884-1c607ae47fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:47.571739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab213ceb-a3d0-4972-b884-1c607ae47fad admin admin] PATH_INFO: `/v3/projects/7191f3dc5f4f40928a309eb6a1b7377c/users/502b2f578e8649409ee7318a89f42956/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:47.627341 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab213ceb-a3d0-4972-b884-1c607ae47fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7191f3dc5f4f40928a309eb6a1b7377c, user_id=502b2f578e8649409ee7318a89f42956, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:47.633521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab213ceb-a3d0-4972-b884-1c607ae47fad admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:47.764503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1104/2206] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:47 2022] PUT /identity/v3/projects/7191f3dc5f4f40928a309eb6a1b7377c/users/502b2f578e8649409ee7318a89f42956/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:47.765976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631177a4-d054-4d1e-b531-ec425ab79059 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:47.785879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631177a4-d054-4d1e-b531-ec425ab79059 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:47.950529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:47.952777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fb291-d6f4-46d5-b5d3-a349acc91cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:47.954441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb291-d6f4-46d5-b5d3-a349acc91cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:47.954883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb291-d6f4-46d5-b5d3-a349acc91cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:47.955265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb291-d6f4-46d5-b5d3-a349acc91cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:47.956187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fb291-d6f4-46d5-b5d3-a349acc91cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:47.959143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fb291-d6f4-46d5-b5d3-a349acc91cd9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:47.996194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1103/2207] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:48.001422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab213ceb-a3d0-4972-b884-1c607ae47fad admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:48.012804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab213ceb-a3d0-4972-b884-1c607ae47fad admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:48.020912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:48.022471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:48.022870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:48.023829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] PATH_INFO: `/v3/projects/7191f3dc5f4f40928a309eb6a1b7377c/users/502b2f578e8649409ee7318a89f42956/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:48.026079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7191f3dc5f4f40928a309eb6a1b7377c, user_id=502b2f578e8649409ee7318a89f42956, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:48.029377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:48.062784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8b88-19e7-4bc7-929e-f42abf037768 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:48.063317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8b88-19e7-4bc7-929e-f42abf037768 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:48.063736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb8b88-19e7-4bc7-929e-f42abf037768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:48.066896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1105/2208] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:47 2022] PUT /identity/v3/projects/7191f3dc5f4f40928a309eb6a1b7377c/users/502b2f578e8649409ee7318a89f42956/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:48.114090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-78cb8b88-19e7-4bc7-929e-f42abf037768 None None] MFA Rules not processed for user `502b2f578e8649409ee7318a89f42956`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:48.116265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-78cb8b88-19e7-4bc7-929e-f42abf037768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:48.240630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1104/2209] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:48.255767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:48.260567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:48.356235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b90f-5b7e-444e-903f-0755cf9e5548 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:48.362759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d3348-33ed-4f0a-8155-bec6ed9308b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:48.363738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3348-33ed-4f0a-8155-bec6ed9308b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:48.364034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3348-33ed-4f0a-8155-bec6ed9308b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:48.365123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3348-33ed-4f0a-8155-bec6ed9308b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:48.380616 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d3348-33ed-4f0a-8155-bec6ed9308b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:48.383389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d3348-33ed-4f0a-8155-bec6ed9308b8 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:48.397889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1106/2210] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:48.545099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb8b88-19e7-4bc7-929e-f42abf037768 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:48.547582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-78cb8b88-19e7-4bc7-929e-f42abf037768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:48.564230 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb8b88-19e7-4bc7-929e-f42abf037768 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:48.568895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:48.571107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:48.571586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:48.572015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:48.654082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:48.656093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:48.669248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1105/2211] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:54.947988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ba95f-f3e1-4b5e-8a3b-db1d0316a7b2 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:54.954877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ba95f-f3e1-4b5e-8a3b-db1d0316a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:54.954877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ba95f-f3e1-4b5e-8a3b-db1d0316a7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:54.990316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-970ba95f-f3e1-4b5e-8a3b-db1d0316a7b2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:54.991605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-970ba95f-f3e1-4b5e-8a3b-db1d0316a7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:55.160463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1107/2212] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:55.296621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:55.299771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:55.526541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f97336-0f0d-4f3d-8efb-69702b06428e service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:55.537545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb902c2-d7cf-49cb-b4b2-18a54e0ed99e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:55.539027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb902c2-d7cf-49cb-b4b2-18a54e0ed99e service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:55.539556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb902c2-d7cf-49cb-b4b2-18a54e0ed99e service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:55.540121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb902c2-d7cf-49cb-b4b2-18a54e0ed99e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:55.562608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb902c2-d7cf-49cb-b4b2-18a54e0ed99e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:55.565644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb902c2-d7cf-49cb-b4b2-18a54e0ed99e service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:55.580574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1106/2213] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:56.215185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ba95f-f3e1-4b5e-8a3b-db1d0316a7b2 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:56.225890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ba95f-f3e1-4b5e-8a3b-db1d0316a7b2 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:56.231634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:56.232277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:56.232561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:56.232837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] PATH_INFO: `/v3/users/5cebd5f4c6614b23b616e7a8cef5d3a2` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:56.234130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cebd5f4c6614b23b616e7a8cef5d3a2)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:56.237107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:56.439313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:56.455543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cebd5f4c6614b23b616e7a8cef5d3a2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:56.456674 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cebd5f4c6614b23b616e7a8cef5d3a2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:56.574938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cebd5f4c6614b23b616e7a8cef5d3a2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:56.588872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cebd5f4c6614b23b616e7a8cef5d3a2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:56.589678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cebd5f4c6614b23b616e7a8cef5d3a2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:56.603697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1108/2214] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:33:56 2022] DELETE /identity/v3/users/5cebd5f4c6614b23b616e7a8cef5d3a2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:56.609262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba24dc-adf9-49bb-ae3f-cfb5bc981ecf None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:56.609750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba24dc-adf9-49bb-ae3f-cfb5bc981ecf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:56.609892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba24dc-adf9-49bb-ae3f-cfb5bc981ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:56.617145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:56.630565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a9ba24dc-adf9-49bb-ae3f-cfb5bc981ecf None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:56.631807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a9ba24dc-adf9-49bb-ae3f-cfb5bc981ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:56.694260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1107/2215] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:33:56.708684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:56.710235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:56.773253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69842940-0031-4272-bbb6-ecdcb7d58918 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:56.777477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20601d-12e0-40e1-8e67-a087256e80ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:56.778091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20601d-12e0-40e1-8e67-a087256e80ae service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:56.778372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20601d-12e0-40e1-8e67-a087256e80ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:56.778678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20601d-12e0-40e1-8e67-a087256e80ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:56.788417 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20601d-12e0-40e1-8e67-a087256e80ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:56.790606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20601d-12e0-40e1-8e67-a087256e80ae service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:56.801169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1109/2216] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:33:57.255839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba24dc-adf9-49bb-ae3f-cfb5bc981ecf None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:57.257316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a9ba24dc-adf9-49bb-ae3f-cfb5bc981ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:57.269285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba24dc-adf9-49bb-ae3f-cfb5bc981ecf None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:57.274078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:57.281194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:57.281194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:57.281194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] PATH_INFO: `/v3/projects/79e8960af316486fac8591fdab033474` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:57.281194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e8960af316486fac8591fdab033474)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:57.281194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:57.380736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e8960af316486fac8591fdab033474', 'request_id': 'req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.387067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e8960af316486fac8591fdab033474', 'request_id': 'req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.392849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e8960af316486fac8591fdab033474', 'request_id': 'req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.452881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] The token cache is being invalidate because project 79e8960af316486fac8591fdab033474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:57.453210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.453878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.455434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1108/2217] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:57 2022] DELETE /identity/v3/projects/79e8960af316486fac8591fdab033474 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:57.459457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20601d-12e0-40e1-8e67-a087256e80ae service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:57.470165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20601d-12e0-40e1-8e67-a087256e80ae service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:57.533743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:57.534690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:57.535036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:57.535374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] PATH_INFO: `/v3/users/502b2f578e8649409ee7318a89f42956` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:57.536778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502b2f578e8649409ee7318a89f42956)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:57.538829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:57.725093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502b2f578e8649409ee7318a89f42956'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.725758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502b2f578e8649409ee7318a89f42956'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.813823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502b2f578e8649409ee7318a89f42956'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.819620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:57.833171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502b2f578e8649409ee7318a89f42956'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.834252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9a8c0c20-be35-4c21-8cd0-0e91ef9978b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502b2f578e8649409ee7318a89f42956'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:57.849622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1110/2218] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:33:57 2022] DELETE /identity/v3/users/502b2f578e8649409ee7318a89f42956 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:58.409637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:58.411191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:58.426285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c4bc7-3e26-47ff-a9df-0d5c749c6276 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:58.489460 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:58.490115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:58.490404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:58.490705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] PATH_INFO: `/v3/projects/7191f3dc5f4f40928a309eb6a1b7377c` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:58.492040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7191f3dc5f4f40928a309eb6a1b7377c)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:58.494541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:58.638891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:58.653433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7191f3dc5f4f40928a309eb6a1b7377c', 'request_id': 'req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:58.659800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7191f3dc5f4f40928a309eb6a1b7377c', 'request_id': 'req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:58.665757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7191f3dc5f4f40928a309eb6a1b7377c', 'request_id': 'req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:58.741639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] The token cache is being invalidate because project 7191f3dc5f4f40928a309eb6a1b7377c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:33:58.743015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:58.743243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-67b98a22-e8bc-4e3f-834a-6b5f3717abbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:33:58.744972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1109/2219] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:33:58 2022] DELETE /identity/v3/projects/7191f3dc5f4f40928a309eb6a1b7377c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:58.750805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5f539-1c50-4048-b859-1987f1d52011 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:58.751611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5f539-1c50-4048-b859-1987f1d52011 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:58.751611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5f539-1c50-4048-b859-1987f1d52011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:58.775066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f8c5f539-1c50-4048-b859-1987f1d52011 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:58.776315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f8c5f539-1c50-4048-b859-1987f1d52011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:58.883522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1111/2220] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:58.886933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d6c2-3a97-4e60-9573-ffeaf7c3a3d0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:58.887217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d6c2-3a97-4e60-9573-ffeaf7c3a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:58.887491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828d6c2-3a97-4e60-9573-ffeaf7c3a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:58.910556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2828d6c2-3a97-4e60-9573-ffeaf7c3a3d0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:58.911771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2828d6c2-3a97-4e60-9573-ffeaf7c3a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:58.923102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1110/2221] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:58.929069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5f539-1c50-4048-b859-1987f1d52011 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:58.939593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5f539-1c50-4048-b859-1987f1d52011 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:58.944797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:58.945483 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:58.945766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:58.946041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:58.946703 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:33:58.947012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:58.948625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:58.961808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1112/2222] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:33:58.966329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828d6c2-3a97-4e60-9573-ffeaf7c3a3d0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:58.975700 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828d6c2-3a97-4e60-9573-ffeaf7c3a3d0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:58.981153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad3c7b-be71-486a-8d01-073eb434854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:58.981775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3c7b-be71-486a-8d01-073eb434854b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:58.982080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3c7b-be71-486a-8d01-073eb434854b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:58.982353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3c7b-be71-486a-8d01-073eb434854b admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:58.983034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad3c7b-be71-486a-8d01-073eb434854b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:58.984981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad3c7b-be71-486a-8d01-073eb434854b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:59.089548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1111/2223] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:58 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:59.089768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:59.099457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c2f0a-e944-432c-aec8-9efbfd6bbc97 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:59.161239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27222e-34d0-4f7c-b404-7d7cb3b931f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:59.161967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27222e-34d0-4f7c-b404-7d7cb3b931f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:59.162250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27222e-34d0-4f7c-b404-7d7cb3b931f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:59.162526 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27222e-34d0-4f7c-b404-7d7cb3b931f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:59.163163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27222e-34d0-4f7c-b404-7d7cb3b931f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:59.165190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27222e-34d0-4f7c-b404-7d7cb3b931f9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:59.243615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1113/2224] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:59 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:59.247345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad3c7b-be71-486a-8d01-073eb434854b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:59.258840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad3c7b-be71-486a-8d01-073eb434854b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:59.263427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836b0df-4c25-4ae5-99e7-fb019bd9f000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:59.264024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836b0df-4c25-4ae5-99e7-fb019bd9f000 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:59.264304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836b0df-4c25-4ae5-99e7-fb019bd9f000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:59.264583 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836b0df-4c25-4ae5-99e7-fb019bd9f000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:59.265264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836b0df-4c25-4ae5-99e7-fb019bd9f000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:59.266855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836b0df-4c25-4ae5-99e7-fb019bd9f000 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:59.276719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1112/2225] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:59.281243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27222e-34d0-4f7c-b404-7d7cb3b931f9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:59.291901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27222e-34d0-4f7c-b404-7d7cb3b931f9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:59.296919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd97c-263d-41df-8983-9c18402352ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:59.297559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd97c-263d-41df-8983-9c18402352ae admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:59.297825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd97c-263d-41df-8983-9c18402352ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:59.298097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd97c-263d-41df-8983-9c18402352ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:59.298732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fd97c-263d-41df-8983-9c18402352ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:59.300388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fd97c-263d-41df-8983-9c18402352ae admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:59.313525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1114/2226] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:33:59.317894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836b0df-4c25-4ae5-99e7-fb019bd9f000 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:59.328164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836b0df-4c25-4ae5-99e7-fb019bd9f000 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:59.332728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619cfd-364b-4598-9786-e16d734b2090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:59.333410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619cfd-364b-4598-9786-e16d734b2090 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:59.333692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619cfd-364b-4598-9786-e16d734b2090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:59.333966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619cfd-364b-4598-9786-e16d734b2090 admin admin] PATH_INFO: `/v3/projects/f33830ea319a4274bd96f975b0b286b4/users/cfcd2690142a48858a87ba7fd14af85e/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:59.349686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5619cfd-364b-4598-9786-e16d734b2090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33830ea319a4274bd96f975b0b286b4, user_id=cfcd2690142a48858a87ba7fd14af85e, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:59.352842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5619cfd-364b-4598-9786-e16d734b2090 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:59.438148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1113/2227] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:59 2022] PUT /identity/v3/projects/f33830ea319a4274bd96f975b0b286b4/users/cfcd2690142a48858a87ba7fd14af85e/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:33:59.449535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf789-c32d-4a6e-9e48-0493fe759c37 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:59.449845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf789-c32d-4a6e-9e48-0493fe759c37 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:59.450476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf789-c32d-4a6e-9e48-0493fe759c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:59.480052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2fcbf789-c32d-4a6e-9e48-0493fe759c37 None None] MFA Rules not processed for user `cfcd2690142a48858a87ba7fd14af85e`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:33:59.481367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2fcbf789-c32d-4a6e-9e48-0493fe759c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:33:59.513555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:33:59.556359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1115/2228] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:33:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:33:59.561044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619cfd-364b-4598-9786-e16d734b2090 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:59.628537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619cfd-364b-4598-9786-e16d734b2090 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:59.633610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38504eb-8792-4d2c-b587-c0be76081d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:59.637357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38504eb-8792-4d2c-b587-c0be76081d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:59.637357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38504eb-8792-4d2c-b587-c0be76081d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:59.637357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38504eb-8792-4d2c-b587-c0be76081d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:59.637357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38504eb-8792-4d2c-b587-c0be76081d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:59.637699 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38504eb-8792-4d2c-b587-c0be76081d33 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:59.724148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1114/2229] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:33:59 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:33:59.728716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf789-c32d-4a6e-9e48-0493fe759c37 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:59.739837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf789-c32d-4a6e-9e48-0493fe759c37 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:59.801875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf5a20-5e0d-43de-96f6-999abded4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:59.802531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5a20-5e0d-43de-96f6-999abded4888 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:59.803048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5a20-5e0d-43de-96f6-999abded4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:59.803048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5a20-5e0d-43de-96f6-999abded4888 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:59.803673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf5a20-5e0d-43de-96f6-999abded4888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:59.806241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf5a20-5e0d-43de-96f6-999abded4888 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:59.941297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1116/2230] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:33:59 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:33:59.945434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38504eb-8792-4d2c-b587-c0be76081d33 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:33:59.964263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38504eb-8792-4d2c-b587-c0be76081d33 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:33:59.970283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db67fa6-b711-48ff-80cc-8f052b54efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:33:59.970925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db67fa6-b711-48ff-80cc-8f052b54efc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:33:59.971263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db67fa6-b711-48ff-80cc-8f052b54efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:33:59.971544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db67fa6-b711-48ff-80cc-8f052b54efc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:33:59.972215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db67fa6-b711-48ff-80cc-8f052b54efc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:33:59.974533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db67fa6-b711-48ff-80cc-8f052b54efc0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:33:59.998563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1115/2231] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:33:59.998775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf5a20-5e0d-43de-96f6-999abded4888 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:00.013684 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf5a20-5e0d-43de-96f6-999abded4888 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:00.019665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1164-f94a-4f6f-b1f9-b44fcd616b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:00.020652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1164-f94a-4f6f-b1f9-b44fcd616b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:00.021161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1164-f94a-4f6f-b1f9-b44fcd616b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:00.021630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e1164-f94a-4f6f-b1f9-b44fcd616b4d admin admin] PATH_INFO: `/v3/projects/cf1dc3ec24c641d0968d23d6067a0aa7/users/e55119728f644e719fd31dc66a53b744/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:00.043197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e1164-f94a-4f6f-b1f9-b44fcd616b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1dc3ec24c641d0968d23d6067a0aa7, user_id=e55119728f644e719fd31dc66a53b744, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:00.046481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e1164-f94a-4f6f-b1f9-b44fcd616b4d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:00.179612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1117/2232] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:33:59 2022] PUT /identity/v3/projects/cf1dc3ec24c641d0968d23d6067a0aa7/users/e55119728f644e719fd31dc66a53b744/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:34:00.188847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db67fa6-b711-48ff-80cc-8f052b54efc0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:00.199527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db67fa6-b711-48ff-80cc-8f052b54efc0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:00.224910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:00.258322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d7389-3639-4d7a-b00f-e3dc5739acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:00.258946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7389-3639-4d7a-b00f-e3dc5739acd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:00.259227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7389-3639-4d7a-b00f-e3dc5739acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:00.259500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d7389-3639-4d7a-b00f-e3dc5739acd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:00.260153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d7389-3639-4d7a-b00f-e3dc5739acd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:00.261832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d7389-3639-4d7a-b00f-e3dc5739acd2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:00.272568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1116/2233] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:34:00.277271 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1164-f94a-4f6f-b1f9-b44fcd616b4d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:00.288164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e1164-f94a-4f6f-b1f9-b44fcd616b4d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:00.293325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:00.294034 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:00.294312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:00.294722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] PATH_INFO: `/v3/projects/cf1dc3ec24c641d0968d23d6067a0aa7/users/e55119728f644e719fd31dc66a53b744/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:00.296658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1dc3ec24c641d0968d23d6067a0aa7, user_id=e55119728f644e719fd31dc66a53b744, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:00.299401 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:00.310791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1118/2234] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:34:00 2022] PUT /identity/v3/projects/cf1dc3ec24c641d0968d23d6067a0aa7/users/e55119728f644e719fd31dc66a53b744/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:34:00.327700 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4eb31-a15e-4278-8bc6-16fbb01fa18f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:00.327994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4eb31-a15e-4278-8bc6-16fbb01fa18f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:00.328277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4eb31-a15e-4278-8bc6-16fbb01fa18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:00.357719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6cb4eb31-a15e-4278-8bc6-16fbb01fa18f None None] MFA Rules not processed for user `e55119728f644e719fd31dc66a53b744`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:00.359013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6cb4eb31-a15e-4278-8bc6-16fbb01fa18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:00.442564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1117/2235] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:34:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:00.453879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:00.455654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:00.518416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f5382-910c-4cfe-9a06-797bb25a7ce3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:00.522118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:00.522723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:00.523010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:00.523315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:00.532886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:00.534344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:00.544683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1119/2236] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:01.619285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7f9f0-7f21-497a-9ca5-3a24918bb138 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:01.620257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7f9f0-7f21-497a-9ca5-3a24918bb138 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:01.620257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7f9f0-7f21-497a-9ca5-3a24918bb138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:01.639945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d5d7f9f0-7f21-497a-9ca5-3a24918bb138 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:01.641188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d5d7f9f0-7f21-497a-9ca5-3a24918bb138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:01.711455 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1118/2237] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:01.740089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:01.741933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:01.781105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:01.828223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91e9c-b49a-4d07-bc1a-24bf79edbaa0 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:01.835371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9874a-3401-40cd-bd71-f01a9ec0893c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:01.835783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9874a-3401-40cd-bd71-f01a9ec0893c service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:01.836124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9874a-3401-40cd-bd71-f01a9ec0893c service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:01.836462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9874a-3401-40cd-bd71-f01a9ec0893c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:01.846096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9874a-3401-40cd-bd71-f01a9ec0893c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:01.847691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9874a-3401-40cd-bd71-f01a9ec0893c service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:01.858925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1120/2238] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:01.939571 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7f9f0-7f21-497a-9ca5-3a24918bb138 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:01.950805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7f9f0-7f21-497a-9ca5-3a24918bb138 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:01.954844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:01.955459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:01.955741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:01.956015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] PATH_INFO: `/v3/users/cfcd2690142a48858a87ba7fd14af85e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:01.957288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcd2690142a48858a87ba7fd14af85e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:01.959387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:02.145187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:02.148048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcd2690142a48858a87ba7fd14af85e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:02.148715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcd2690142a48858a87ba7fd14af85e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:02.274129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcd2690142a48858a87ba7fd14af85e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:02.274129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcd2690142a48858a87ba7fd14af85e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:02.280263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcd2690142a48858a87ba7fd14af85e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:02.292984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1119/2239] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:34:01 2022] DELETE /identity/v3/users/cfcd2690142a48858a87ba7fd14af85e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:34:02.297457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ca8e6-c8bb-4b69-b707-5edefa826b47 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:02.297796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ca8e6-c8bb-4b69-b707-5edefa826b47 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:02.298071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ca8e6-c8bb-4b69-b707-5edefa826b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:02.317279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-d73ca8e6-c8bb-4b69-b707-5edefa826b47 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:02.318510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d73ca8e6-c8bb-4b69-b707-5edefa826b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:02.387557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1121/2240] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:02.397196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:02.398676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:02.532922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18d671-3120-4971-84db-b14600f701bd admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:02.538964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217392a6-e929-4dc8-bbc5-a818c4fc06e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:02.540582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217392a6-e929-4dc8-bbc5-a818c4fc06e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:02.543001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217392a6-e929-4dc8-bbc5-a818c4fc06e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:02.543001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217392a6-e929-4dc8-bbc5-a818c4fc06e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:02.554584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217392a6-e929-4dc8-bbc5-a818c4fc06e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:02.557312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217392a6-e929-4dc8-bbc5-a818c4fc06e7 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:02.569958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1120/2241] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:03.454896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ca8e6-c8bb-4b69-b707-5edefa826b47 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:03.455509 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d73ca8e6-c8bb-4b69-b707-5edefa826b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:03.467660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ca8e6-c8bb-4b69-b707-5edefa826b47 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:03.473728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:03.474157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:03.474452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:03.474726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] PATH_INFO: `/v3/projects/f33830ea319a4274bd96f975b0b286b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:03.477816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33830ea319a4274bd96f975b0b286b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:03.477925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:03.597850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33830ea319a4274bd96f975b0b286b4', 'request_id': 'req-ed3c8492-38ab-4112-8b62-abc9000a337c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:03.604737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33830ea319a4274bd96f975b0b286b4', 'request_id': 'req-ed3c8492-38ab-4112-8b62-abc9000a337c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:03.610505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33830ea319a4274bd96f975b0b286b4', 'request_id': 'req-ed3c8492-38ab-4112-8b62-abc9000a337c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:03.688004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] The token cache is being invalidate because project f33830ea319a4274bd96f975b0b286b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:34:03.688415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:03.689148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:03.690781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1122/2242] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:34:03 2022] DELETE /identity/v3/projects/f33830ea319a4274bd96f975b0b286b4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:34:03.694862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217392a6-e929-4dc8-bbc5-a818c4fc06e7 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:03.704605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217392a6-e929-4dc8-bbc5-a818c4fc06e7 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:03.763559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:03.764232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:03.764511 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:03.764788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] PATH_INFO: `/v3/users/e55119728f644e719fd31dc66a53b744` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:03.766170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55119728f644e719fd31dc66a53b744)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:03.768189 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:03.971484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55119728f644e719fd31dc66a53b744'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:03.972420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55119728f644e719fd31dc66a53b744'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:04.059767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55119728f644e719fd31dc66a53b744'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:04.060856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55119728f644e719fd31dc66a53b744'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:04.075052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:04.077706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d041d21f-3342-4acf-ac11-9f4ac159649f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55119728f644e719fd31dc66a53b744'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:04.092029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1121/2243] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:34:03 2022] DELETE /identity/v3/users/e55119728f644e719fd31dc66a53b744 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:34:04.964466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:04.964466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:04.985287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8492-38ab-4112-8b62-abc9000a337c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:05.043909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:05.102346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:05.103390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:05.103837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:05.104284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] PATH_INFO: `/v3/projects/cf1dc3ec24c641d0968d23d6067a0aa7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:05.105737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1dc3ec24c641d0968d23d6067a0aa7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:05.108061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:05.231557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1dc3ec24c641d0968d23d6067a0aa7', 'request_id': 'req-9596076f-b0b5-4dde-8fbb-0b995c17a684'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:05.253128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1dc3ec24c641d0968d23d6067a0aa7', 'request_id': 'req-9596076f-b0b5-4dde-8fbb-0b995c17a684'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:05.258094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1dc3ec24c641d0968d23d6067a0aa7', 'request_id': 'req-9596076f-b0b5-4dde-8fbb-0b995c17a684'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:05.375383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] The token cache is being invalidate because project cf1dc3ec24c641d0968d23d6067a0aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:34:05.375708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:05.376350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9596076f-b0b5-4dde-8fbb-0b995c17a684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:05.381002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1123/2244] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:34:04 2022] DELETE /identity/v3/projects/cf1dc3ec24c641d0968d23d6067a0aa7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:34:05.383958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7aa7a-84f4-4c25-8064-c6f303667762 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:05.384881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7aa7a-84f4-4c25-8064-c6f303667762 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:05.385056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7aa7a-84f4-4c25-8064-c6f303667762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:05.409165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e8e7aa7a-84f4-4c25-8064-c6f303667762 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:05.410396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e8e7aa7a-84f4-4c25-8064-c6f303667762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:05.498973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1122/2245] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:34:05.501573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd4e3-b6de-4b99-9932-a25045a8aa18 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:05.501875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd4e3-b6de-4b99-9932-a25045a8aa18 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:05.502155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd4e3-b6de-4b99-9932-a25045a8aa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:05.525354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c02dd4e3-b6de-4b99-9932-a25045a8aa18 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:05.527239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c02dd4e3-b6de-4b99-9932-a25045a8aa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:05.535783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1124/2246] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:05.540449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7aa7a-84f4-4c25-8064-c6f303667762 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:05.553032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7aa7a-84f4-4c25-8064-c6f303667762 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:05.562906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:05.564378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:05.564847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:05.565486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:05.567025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:34:05.567512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:05.570255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:05.586633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1123/2247] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:34:05.591235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dd4e3-b6de-4b99-9932-a25045a8aa18 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:05.600893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dd4e3-b6de-4b99-9932-a25045a8aa18 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:05.606609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0643b6-a400-4dbf-a29e-3491a6fe21d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:05.607442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0643b6-a400-4dbf-a29e-3491a6fe21d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:05.607729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0643b6-a400-4dbf-a29e-3491a6fe21d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:05.608007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0643b6-a400-4dbf-a29e-3491a6fe21d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:05.609701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0643b6-a400-4dbf-a29e-3491a6fe21d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:05.611752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0643b6-a400-4dbf-a29e-3491a6fe21d3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:05.746652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1125/2248] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:34:05 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:34:05.749035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:05.761400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fef8e3-067e-4402-9209-a54a52a28c9a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:05.856486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e86853-1ae0-412c-8c92-7b9abab9b329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:05.857336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86853-1ae0-412c-8c92-7b9abab9b329 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:05.857673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86853-1ae0-412c-8c92-7b9abab9b329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:05.858088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86853-1ae0-412c-8c92-7b9abab9b329 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:05.858940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e86853-1ae0-412c-8c92-7b9abab9b329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:05.861382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e86853-1ae0-412c-8c92-7b9abab9b329 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:06.040319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1124/2249] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:34:05 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:34:06.041867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0643b6-a400-4dbf-a29e-3491a6fe21d3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:06.052500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0643b6-a400-4dbf-a29e-3491a6fe21d3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:06.057430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea792bf-b474-422f-bb7a-b80d2ca1b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:06.058050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea792bf-b474-422f-bb7a-b80d2ca1b5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:06.058334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea792bf-b474-422f-bb7a-b80d2ca1b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:06.058608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea792bf-b474-422f-bb7a-b80d2ca1b5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:06.059268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea792bf-b474-422f-bb7a-b80d2ca1b5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:06.060897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea792bf-b474-422f-bb7a-b80d2ca1b5e2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:06.072567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1126/2250] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:34:06.078041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e86853-1ae0-412c-8c92-7b9abab9b329 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:06.093457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e86853-1ae0-412c-8c92-7b9abab9b329 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:06.100403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7139ff0-9653-4287-b8c1-f528e45e1de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:06.101078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7139ff0-9653-4287-b8c1-f528e45e1de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:06.101363 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7139ff0-9653-4287-b8c1-f528e45e1de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:06.101639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7139ff0-9653-4287-b8c1-f528e45e1de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:06.102335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7139ff0-9653-4287-b8c1-f528e45e1de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:06.103978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7139ff0-9653-4287-b8c1-f528e45e1de6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:06.117092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1125/2251] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:34:06.121820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea792bf-b474-422f-bb7a-b80d2ca1b5e2 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:06.133327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea792bf-b474-422f-bb7a-b80d2ca1b5e2 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:06.139844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:06.140535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:06.140816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:06.141133 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] PATH_INFO: `/v3/projects/33e1ee524441489389483b565d6ab7a0/users/621bd7d34e214f7aa0ab2056c6019f68/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:06.159406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e1ee524441489389483b565d6ab7a0, user_id=621bd7d34e214f7aa0ab2056c6019f68, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:06.162258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:06.288851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1127/2252] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:34:06 2022] PUT /identity/v3/projects/33e1ee524441489389483b565d6ab7a0/users/621bd7d34e214f7aa0ab2056c6019f68/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:34:06.299223 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73fe90-808c-4c7c-8d32-c86631e2a086 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:06.299512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73fe90-808c-4c7c-8d32-c86631e2a086 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:06.299786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73fe90-808c-4c7c-8d32-c86631e2a086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:06.346417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5a73fe90-808c-4c7c-8d32-c86631e2a086 None None] MFA Rules not processed for user `621bd7d34e214f7aa0ab2056c6019f68`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:06.348720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5a73fe90-808c-4c7c-8d32-c86631e2a086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:06.434142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:06.470074 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1126/2253] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:06.484247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:06.486716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:06.568826 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e89875-d579-45b3-8460-72581dcaa428 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:06.573511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:06.574163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:06.574443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:06.574698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:06.588862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:06.590484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:06.600696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1128/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:09.198354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fe7e-1fbc-46ac-b8ba-d793fa81bf3c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:09.198862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fe7e-1fbc-46ac-b8ba-d793fa81bf3c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:09.198943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fe7e-1fbc-46ac-b8ba-d793fa81bf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:09.227708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9658fe7e-1fbc-46ac-b8ba-d793fa81bf3c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:09.229013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9658fe7e-1fbc-46ac-b8ba-d793fa81bf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:09.308784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1127/2255] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:09.327122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:09.331876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:09.335866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:09.441438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd1db-d9e8-4e13-b9f6-d04870ff206f service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:09.447978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecbf16-9dd6-4e82-bc38-92dfe6862320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:09.448629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecbf16-9dd6-4e82-bc38-92dfe6862320 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:09.448913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecbf16-9dd6-4e82-bc38-92dfe6862320 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:09.449445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecbf16-9dd6-4e82-bc38-92dfe6862320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:09.459238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecbf16-9dd6-4e82-bc38-92dfe6862320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:09.460860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecbf16-9dd6-4e82-bc38-92dfe6862320 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:09.471683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1129/2256] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:09.616120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f5d2-7956-47e1-8660-4befc5977937 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:09.616416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f5d2-7956-47e1-8660-4befc5977937 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:09.616700 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f5d2-7956-47e1-8660-4befc5977937 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:09.618666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1128/2257] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:34:09.625025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0603c4-f951-4d61-bb57-3b3abcf83b81 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:09.625378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0603c4-f951-4d61-bb57-3b3abcf83b81 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:09.628469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0603c4-f951-4d61-bb57-3b3abcf83b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:09.647874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0f0603c4-f951-4d61-bb57-3b3abcf83b81 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:09.649178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0f0603c4-f951-4d61-bb57-3b3abcf83b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:09.658869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1130/2258] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:09.676219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656f5d2-7956-47e1-8660-4befc5977937 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:09.678068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3656f5d2-7956-47e1-8660-4befc5977937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:09.781860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656f5d2-7956-47e1-8660-4befc5977937 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:09.785749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e63b1-5783-46f3-83e2-c1b61a714a1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a29dd8d28f44f0b311d167fd39b4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:09.786362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e63b1-5783-46f3-83e2-c1b61a714a1d service glance] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:09.786646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e63b1-5783-46f3-83e2-c1b61a714a1d service glance] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:09.786929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e63b1-5783-46f3-83e2-c1b61a714a1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:09.798319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e63b1-5783-46f3-83e2-c1b61a714a1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:09.799792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e63b1-5783-46f3-83e2-c1b61a714a1d service glance] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:09.811586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1129/2259] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:09.975481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0603c4-f951-4d61-bb57-3b3abcf83b81 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:09.986529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0603c4-f951-4d61-bb57-3b3abcf83b81 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:09.991110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:09.991736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:09.993686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:09.993686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] PATH_INFO: `/v3/users/621bd7d34e214f7aa0ab2056c6019f68` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:09.994047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621bd7d34e214f7aa0ab2056c6019f68)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:09.995968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:10.044302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27648-c18c-4867-be74-59b706cff62d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.044592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27648-c18c-4867-be74-59b706cff62d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.044872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce27648-c18c-4867-be74-59b706cff62d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.046262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1130/2260] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:34:10.050592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3646-d7ee-4143-9f00-c72140bb5d3e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.050883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3646-d7ee-4143-9f00-c72140bb5d3e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.051186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb3646-d7ee-4143-9f00-c72140bb5d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.072684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5efb3646-d7ee-4143-9f00-c72140bb5d3e None None] MFA Rules not processed for user `fa7ce8d93f864130a3c079b1aec6b678`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:10.073926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5efb3646-d7ee-4143-9f00-c72140bb5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:10.140202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1131/2261] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:34:10.154919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb3646-d7ee-4143-9f00-c72140bb5d3e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:10.155561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5efb3646-d7ee-4143-9f00-c72140bb5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:10.167296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb3646-d7ee-4143-9f00-c72140bb5d3e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:10.172179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621bd7d34e214f7aa0ab2056c6019f68'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:10.172807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a946077-b02d-4005-bd9d-1f09d8a762f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:10.172910 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621bd7d34e214f7aa0ab2056c6019f68'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:10.173019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946077-b02d-4005-bd9d-1f09d8a762f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.173019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946077-b02d-4005-bd9d-1f09d8a762f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.173019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a946077-b02d-4005-bd9d-1f09d8a762f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.174861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6a946077-b02d-4005-bd9d-1f09d8a762f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:10.185486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a946077-b02d-4005-bd9d-1f09d8a762f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:10.186954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a946077-b02d-4005-bd9d-1f09d8a762f0 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:10.190524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:10.196266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1132/2262] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:10.247638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621bd7d34e214f7aa0ab2056c6019f68'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:10.262870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621bd7d34e214f7aa0ab2056c6019f68'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:10.263712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-035f6716-7ac6-42d4-a7b7-abaf7e8e9100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621bd7d34e214f7aa0ab2056c6019f68'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:10.282792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1131/2263] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:34:09 2022] DELETE /identity/v3/users/621bd7d34e214f7aa0ab2056c6019f68 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:34:10.287545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8421-8fb1-4e4e-a56e-6a89b24d76b7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.288040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8421-8fb1-4e4e-a56e-6a89b24d76b7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.288244 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f8421-8fb1-4e4e-a56e-6a89b24d76b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.290437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06de82-ec1e-4c99-a446-3d55cdce6399 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.290761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06de82-ec1e-4c99-a446-3d55cdce6399 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.291025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06de82-ec1e-4c99-a446-3d55cdce6399 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.292366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1132/2264] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:34:10.298148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355339b3-3288-48df-8b58-e8a4399ff71d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.298439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355339b3-3288-48df-8b58-e8a4399ff71d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.298720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355339b3-3288-48df-8b58-e8a4399ff71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.312126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-644f8421-8fb1-4e4e-a56e-6a89b24d76b7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:10.313464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-644f8421-8fb1-4e4e-a56e-6a89b24d76b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:10.320965 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-355339b3-3288-48df-8b58-e8a4399ff71d None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:10.322497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-355339b3-3288-48df-8b58-e8a4399ff71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:10.376276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:10.389375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1133/2265] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:10.400100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f8421-8fb1-4e4e-a56e-6a89b24d76b7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:10.405468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-644f8421-8fb1-4e4e-a56e-6a89b24d76b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:10.405587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1133/2266] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:34:10.413646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355339b3-3288-48df-8b58-e8a4399ff71d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:10.415759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-355339b3-3288-48df-8b58-e8a4399ff71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:10.473436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f8421-8fb1-4e4e-a56e-6a89b24d76b7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:10.477940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d500a6b-767e-4d43-b2a3-06c38372d9f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:10.478553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500a6b-767e-4d43-b2a3-06c38372d9f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.478875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500a6b-767e-4d43-b2a3-06c38372d9f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.479132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d500a6b-767e-4d43-b2a3-06c38372d9f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.481812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355339b3-3288-48df-8b58-e8a4399ff71d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:10.485586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:10.486267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.486625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.486972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.488276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d500a6b-767e-4d43-b2a3-06c38372d9f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:10.489739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d500a6b-767e-4d43-b2a3-06c38372d9f7 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:10.497365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:10.498808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:10.499626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1134/2267] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:34:10.500443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d500a6b-767e-4d43-b2a3-06c38372d9f7 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:10.509333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d500a6b-767e-4d43-b2a3-06c38372d9f7 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:10.512185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1134/2268] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:34:10.513094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:10.513815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:10.514103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:10.514372 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:10.516158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:10.588778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:10.589927 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:10.602837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1135/2269] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:11.341120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:11.342851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:11.358515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ca1a7-1ae8-4900-8bd2-c54f2b003a09 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:11.370433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:11.371244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:11.371531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:11.371995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] PATH_INFO: `/v3/projects/33e1ee524441489389483b565d6ab7a0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:11.373230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e1ee524441489389483b565d6ab7a0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:11.375626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:11.507317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e1ee524441489389483b565d6ab7a0', 'request_id': 'req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:11.513795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e1ee524441489389483b565d6ab7a0', 'request_id': 'req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:11.521376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e1ee524441489389483b565d6ab7a0', 'request_id': 'req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:11.631859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] The token cache is being invalidate because project 33e1ee524441489389483b565d6ab7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:34:11.632157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:11.632866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-69f770aa-0f3e-4db3-ab8a-b24d56b45b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:34:11.634513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1135/2270] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:34:11 2022] DELETE /identity/v3/projects/33e1ee524441489389483b565d6ab7a0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:34:13.074115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:13.075846 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:13.126067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:13.157220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a16398-9584-4fc8-ac5c-f265aebf2e9b service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:13.222439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:13.224209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:13.224711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:13.225021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:13.227072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:13.240413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:13.246732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:13.254868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1136/2271] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:14.248179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb4619-ba43-4de0-b648-9285694f2bef None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:14.248735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb4619-ba43-4de0-b648-9285694f2bef None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:14.248735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb4619-ba43-4de0-b648-9285694f2bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:14.272804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a5bb4619-ba43-4de0-b648-9285694f2bef None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:14.274255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a5bb4619-ba43-4de0-b648-9285694f2bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:14.339275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1136/2272] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:14.357118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:14.358696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:14.451836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6eea0f-aef5-4ff8-91a4-6d3ee8dc3c96 service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:14.460773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:14.461443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:14.461729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:14.462004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:14.472273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:14.473956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:14.484733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1137/2273] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:17.181608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0984a-7fd2-45d5-b218-873faf6e58d0 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:17.182108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0984a-7fd2-45d5-b218-873faf6e58d0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:17.183178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0984a-7fd2-45d5-b218-873faf6e58d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:17.203384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-41d0984a-7fd2-45d5-b218-873faf6e58d0 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:17.204715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-41d0984a-7fd2-45d5-b218-873faf6e58d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:17.214385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:17.263330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1137/2274] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:34:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:17.276089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:17.277598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:17.352614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:17.369532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000763d-762a-4cfe-bed8-8e876f348ed6 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:17.375215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:17.375856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:17.376470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:17.376470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:17.385389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:17.386988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:17.395457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1138/2275] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:34:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:18.525888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff1512-7967-4b86-ab1e-d79c52f0b11f None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:18.526469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff1512-7967-4b86-ab1e-d79c52f0b11f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:18.526564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff1512-7967-4b86-ab1e-d79c52f0b11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:18.549683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a2ff1512-7967-4b86-ab1e-d79c52f0b11f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:18.550906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a2ff1512-7967-4b86-ab1e-d79c52f0b11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:18.559234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1138/2276] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:18.586754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:18.589148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:18.605349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c7f15-0458-4ba9-a54a-814933e5d0e2 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:18.611161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbe745-80c5-48bf-8410-3c82e44f9e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:18.612212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe745-80c5-48bf-8410-3c82e44f9e1c service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:18.613208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe745-80c5-48bf-8410-3c82e44f9e1c service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:18.613208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbe745-80c5-48bf-8410-3c82e44f9e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:18.624650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbe745-80c5-48bf-8410-3c82e44f9e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:18.626390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbe745-80c5-48bf-8410-3c82e44f9e1c service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:18.637969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1139/2277] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:28.542045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=22 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:28.632658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=14 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:37.249508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b1b1a-7060-47d2-915b-d5f9fdacc86e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:37.250176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b1b1a-7060-47d2-915b-d5f9fdacc86e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:37.250176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b1b1a-7060-47d2-915b-d5f9fdacc86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:37.272002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e94b1b1a-7060-47d2-915b-d5f9fdacc86e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:37.273312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e94b1b1a-7060-47d2-915b-d5f9fdacc86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:37.282260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1139/2278] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:37.306136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbe745-80c5-48bf-8410-3c82e44f9e1c service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:37.318292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbe745-80c5-48bf-8410-3c82e44f9e1c service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:37.324121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9303060-dc5c-42c8-931e-de93e999349f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:37.324747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303060-dc5c-42c8-931e-de93e999349f service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:37.325203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303060-dc5c-42c8-931e-de93e999349f service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:37.325511 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9303060-dc5c-42c8-931e-de93e999349f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:37.335190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9303060-dc5c-42c8-931e-de93e999349f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:37.336844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9303060-dc5c-42c8-931e-de93e999349f service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:37.347959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1140/2279] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:34:40.072664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c1221-d73b-4f17-bbc2-00ee6e954381 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:40.073188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c1221-d73b-4f17-bbc2-00ee6e954381 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:40.073295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c1221-d73b-4f17-bbc2-00ee6e954381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:40.097291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2d5c1221-d73b-4f17-bbc2-00ee6e954381 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:40.099183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2d5c1221-d73b-4f17-bbc2-00ee6e954381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:40.107082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1140/2280] 10.222.0.39 () {58 vars in 967 bytes} [Mon Sep 5 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:34:40.119788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9303060-dc5c-42c8-931e-de93e999349f service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:34:40.130806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9303060-dc5c-42c8-931e-de93e999349f service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:34:40.135724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365e1f9-c625-4769-928a-9e8e71e20b93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:34:40.136317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e1f9-c625-4769-928a-9e8e71e20b93 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:40.136599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e1f9-c625-4769-928a-9e8e71e20b93 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:40.136875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e1f9-c625-4769-928a-9e8e71e20b93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:40.146199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365e1f9-c625-4769-928a-9e8e71e20b93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:34:40.147781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365e1f9-c625-4769-928a-9e8e71e20b93 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:34:40.156602 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1141/2281] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:34:50.090582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=6 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:50.152748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=12 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:34:56.615854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111c8b5-a968-4079-a80e-6d6816f26da1 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:34:56.617001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111c8b5-a968-4079-a80e-6d6816f26da1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:34:56.617001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111c8b5-a968-4079-a80e-6d6816f26da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:34:56.636031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4111c8b5-a968-4079-a80e-6d6816f26da1 None None] MFA Rules not processed for user `0adca5f96dba4aacac7746f5d751e800`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:34:56.637269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4111c8b5-a968-4079-a80e-6d6816f26da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:34:56.691522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1141/2282] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:35:06.684641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=25 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:17.562865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaf0d-9e1a-424c-b3cf-8a1aaf3b9487 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:17.564076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaf0d-9e1a-424c-b3cf-8a1aaf3b9487 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:17.564076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977aaf0d-9e1a-424c-b3cf-8a1aaf3b9487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:17.584236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-977aaf0d-9e1a-424c-b3cf-8a1aaf3b9487 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:35:17.585489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-977aaf0d-9e1a-424c-b3cf-8a1aaf3b9487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:35:17.594180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1142/2283] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:35:17.609648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111c8b5-a968-4079-a80e-6d6816f26da1 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:35:17.628295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111c8b5-a968-4079-a80e-6d6816f26da1 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:35:17.635206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572ef19-1098-4a59-892a-cdbbba9cfe1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:35:17.636111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572ef19-1098-4a59-892a-cdbbba9cfe1d service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:17.636565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572ef19-1098-4a59-892a-cdbbba9cfe1d service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:17.637048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572ef19-1098-4a59-892a-cdbbba9cfe1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:17.647582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572ef19-1098-4a59-892a-cdbbba9cfe1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:35:17.653729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572ef19-1098-4a59-892a-cdbbba9cfe1d service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:35:17.669461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1142/2284] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:35:20.296656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5d7f-b451-4933-b3da-e5c4eb5dcdcc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:20.300144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5d7f-b451-4933-b3da-e5c4eb5dcdcc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:20.300144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f5d7f-b451-4933-b3da-e5c4eb5dcdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:20.331991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fb6f5d7f-b451-4933-b3da-e5c4eb5dcdcc None None] MFA Rules not processed for user `4ac91d9adcf244a6bc7de4a98c565de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:35:20.331991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fb6f5d7f-b451-4933-b3da-e5c4eb5dcdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:35:20.404622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1143/2285] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:35:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:35:21.072068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757a534-4cbb-4dc4-a37b-94099b7c91ee None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:21.072637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757a534-4cbb-4dc4-a37b-94099b7c91ee None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:21.072637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757a534-4cbb-4dc4-a37b-94099b7c91ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:21.094390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e757a534-4cbb-4dc4-a37b-94099b7c91ee None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:35:21.095753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e757a534-4cbb-4dc4-a37b-94099b7c91ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:35:21.104515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1143/2286] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:35:21.144138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f5d7f-b451-4933-b3da-e5c4eb5dcdcc None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:35:21.162177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f5d7f-b451-4933-b3da-e5c4eb5dcdcc None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:35:21.167903 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55453f5b-d77f-47f5-8625-96074e63fdad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:35:21.168522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55453f5b-d77f-47f5-8625-96074e63fdad service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:21.168885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55453f5b-d77f-47f5-8625-96074e63fdad service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:21.169090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55453f5b-d77f-47f5-8625-96074e63fdad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:21.179349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55453f5b-d77f-47f5-8625-96074e63fdad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:35:21.180964 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55453f5b-d77f-47f5-8625-96074e63fdad service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:35:21.191292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1144/2287] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:35:24.002228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1fb59-46e4-4aa4-9a07-3b75e24629b3 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:24.002784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1fb59-46e4-4aa4-9a07-3b75e24629b3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:24.002784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1fb59-46e4-4aa4-9a07-3b75e24629b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:24.022489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c3a1fb59-46e4-4aa4-9a07-3b75e24629b3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:35:24.023714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c3a1fb59-46e4-4aa4-9a07-3b75e24629b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:35:24.031591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1144/2288] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:35:24.054441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55453f5b-d77f-47f5-8625-96074e63fdad service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:35:24.065528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55453f5b-d77f-47f5-8625-96074e63fdad service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:35:24.071294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698ea18-6150-4539-9b2f-910baf61df92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:35:24.072736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ea18-6150-4539-9b2f-910baf61df92 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:24.073056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ea18-6150-4539-9b2f-910baf61df92 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:24.073333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ea18-6150-4539-9b2f-910baf61df92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:24.082430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698ea18-6150-4539-9b2f-910baf61df92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:35:24.084051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698ea18-6150-4539-9b2f-910baf61df92 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:35:24.093952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1145/2289] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:35:29.305000 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609e193-2a8e-4859-8761-aab262979ccd None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:29.305543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609e193-2a8e-4859-8761-aab262979ccd None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:29.305543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609e193-2a8e-4859-8761-aab262979ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:29.325905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0609e193-2a8e-4859-8761-aab262979ccd None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:35:29.327138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0609e193-2a8e-4859-8761-aab262979ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:35:29.336276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1145/2290] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:35:29.352716 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698ea18-6150-4539-9b2f-910baf61df92 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:35:29.366465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698ea18-6150-4539-9b2f-910baf61df92 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:35:29.377523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1ae00-1bc2-4bf3-94bc-4a84771abcbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:35:29.379010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1ae00-1bc2-4bf3-94bc-4a84771abcbb service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:29.379010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1ae00-1bc2-4bf3-94bc-4a84771abcbb service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:29.379010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1ae00-1bc2-4bf3-94bc-4a84771abcbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:29.387954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1ae00-1bc2-4bf3-94bc-4a84771abcbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:35:29.389624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1ae00-1bc2-4bf3-94bc-4a84771abcbb service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:35:29.400676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1146/2291] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:35:30.097957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23132b41-1396-45f4-ad9e-3d6fe0f973fe None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:30.098252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23132b41-1396-45f4-ad9e-3d6fe0f973fe None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:30.098556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23132b41-1396-45f4-ad9e-3d6fe0f973fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:30.119513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-23132b41-1396-45f4-ad9e-3d6fe0f973fe None None] MFA Rules not processed for user `567ad9bf5078478a9ef462229bf7f930`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:35:30.120716 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-23132b41-1396-45f4-ad9e-3d6fe0f973fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:35:30.189618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1146/2292] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:35:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:35:34.645458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e65c-8f52-4279-949a-bb454dd2899d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:34.646005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e65c-8f52-4279-949a-bb454dd2899d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:34.646005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17e65c-8f52-4279-949a-bb454dd2899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:34.666562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7e17e65c-8f52-4279-949a-bb454dd2899d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:35:34.667787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7e17e65c-8f52-4279-949a-bb454dd2899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:35:34.676778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1147/2293] 10.222.0.70 () {58 vars in 1016 bytes} [Mon Sep 5 12:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:35:34.693049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23132b41-1396-45f4-ad9e-3d6fe0f973fe None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:35:34.705672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23132b41-1396-45f4-ad9e-3d6fe0f973fe None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:35:34.711259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d4f2-36a5-48c9-abfb-280eb4e0a980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:35:34.713697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d4f2-36a5-48c9-abfb-280eb4e0a980 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:34.713697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d4f2-36a5-48c9-abfb-280eb4e0a980 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:34.713697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d4f2-36a5-48c9-abfb-280eb4e0a980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:34.721218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d4f2-36a5-48c9-abfb-280eb4e0a980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:35:34.722798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d4f2-36a5-48c9-abfb-280eb4e0a980 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:35:34.732344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1147/2294] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:35:44.661366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=49 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:44.730501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=46 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:35:46.919615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525863e-d1a9-400d-b624-2e458cf22182 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:35:46.920175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525863e-d1a9-400d-b624-2e458cf22182 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:35:46.920278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525863e-d1a9-400d-b624-2e458cf22182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:35:46.948057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c525863e-d1a9-400d-b624-2e458cf22182 None None] MFA Rules not processed for user `8b016f7487c546c1ab2cd0ff815099f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:35:46.949328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c525863e-d1a9-400d-b624-2e458cf22182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:35:47.009599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1148/2295] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:35:57.002882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=25 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:10.512870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1270-5d8c-43fc-b6bf-d23cb42553d2 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:10.513409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1270-5d8c-43fc-b6bf-d23cb42553d2 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:10.513409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1270-5d8c-43fc-b6bf-d23cb42553d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:10.536468 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1b8f1270-5d8c-43fc-b6bf-d23cb42553d2 None None] MFA Rules not processed for user `457d3a58fbd34c2c8d5e082e58b56134`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:36:10.536816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1b8f1270-5d8c-43fc-b6bf-d23cb42553d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:10.596201 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1148/2296] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:36:11.344708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525863e-d1a9-400d-b624-2e458cf22182 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:11.346767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c525863e-d1a9-400d-b624-2e458cf22182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:11.409289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525863e-d1a9-400d-b624-2e458cf22182 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:11.413013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642ebf2-8dfc-4cd8-9a7f-b20105addec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:11.413682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642ebf2-8dfc-4cd8-9a7f-b20105addec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:11.413963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642ebf2-8dfc-4cd8-9a7f-b20105addec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:11.414237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642ebf2-8dfc-4cd8-9a7f-b20105addec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:11.416002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0642ebf2-8dfc-4cd8-9a7f-b20105addec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:11.431035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642ebf2-8dfc-4cd8-9a7f-b20105addec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:11.433859 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642ebf2-8dfc-4cd8-9a7f-b20105addec2 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:11.445499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1149/2297] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:12.570333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f1270-5d8c-43fc-b6bf-d23cb42553d2 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:12.571902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1b8f1270-5d8c-43fc-b6bf-d23cb42553d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:12.584739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f1270-5d8c-43fc-b6bf-d23cb42553d2 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:12.588393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78dd36-1fb7-4547-886c-2c94fb1481c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:12.592725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78dd36-1fb7-4547-886c-2c94fb1481c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:12.592725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78dd36-1fb7-4547-886c-2c94fb1481c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:12.592725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78dd36-1fb7-4547-886c-2c94fb1481c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:12.592725 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7a78dd36-1fb7-4547-886c-2c94fb1481c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:12.604998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78dd36-1fb7-4547-886c-2c94fb1481c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:12.606445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78dd36-1fb7-4547-886c-2c94fb1481c9 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:12.618717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1149/2298] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:13.714047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547ec59-5f09-4211-b701-5e636165e4b8 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:13.714581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547ec59-5f09-4211-b701-5e636165e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:13.714581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547ec59-5f09-4211-b701-5e636165e4b8 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:13.716076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1150/2299] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:36:13.732749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01fa49-87ea-4301-bfe1-cd97ddec3999 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:13.746397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01fa49-87ea-4301-bfe1-cd97ddec3999 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:13.746397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01fa49-87ea-4301-bfe1-cd97ddec3999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:13.756719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-6a01fa49-87ea-4301-bfe1-cd97ddec3999 None None] MFA Rules not processed for user `727c462d975449c7807f774df4e4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:36:13.758174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6a01fa49-87ea-4301-bfe1-cd97ddec3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:13.779514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1150/2300] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:36:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:36:13.804881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547ec59-5f09-4211-b701-5e636165e4b8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:13.807034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7547ec59-5f09-4211-b701-5e636165e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:13.824220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547ec59-5f09-4211-b701-5e636165e4b8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:13.839321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942bc4-e4df-4ee4-97fc-7a8ad07fcedc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:13.839321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942bc4-e4df-4ee4-97fc-7a8ad07fcedc service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:13.839321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942bc4-e4df-4ee4-97fc-7a8ad07fcedc service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:13.839321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942bc4-e4df-4ee4-97fc-7a8ad07fcedc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:13.850628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942bc4-e4df-4ee4-97fc-7a8ad07fcedc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:13.852253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942bc4-e4df-4ee4-97fc-7a8ad07fcedc service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:13.869083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1151/2301] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:13.990623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01fa49-87ea-4301-bfe1-cd97ddec3999 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:13.992068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6a01fa49-87ea-4301-bfe1-cd97ddec3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:14.006271 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01fa49-87ea-4301-bfe1-cd97ddec3999 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:14.011599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:14.012255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:14.012528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:14.012931 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] PATH_INFO: `/v3/users/0adca5f96dba4aacac7746f5d751e800` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:14.014081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adca5f96dba4aacac7746f5d751e800)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:14.016036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:14.220153 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adca5f96dba4aacac7746f5d751e800'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.220747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adca5f96dba4aacac7746f5d751e800'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.287641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adca5f96dba4aacac7746f5d751e800'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.301991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adca5f96dba4aacac7746f5d751e800'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.302736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adca5f96dba4aacac7746f5d751e800'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.316723 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1151/2302] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:36:13 2022] DELETE /identity/v3/users/0adca5f96dba4aacac7746f5d751e800 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:36:14.627784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942bc4-e4df-4ee4-97fc-7a8ad07fcedc service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:14.643917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942bc4-e4df-4ee4-97fc-7a8ad07fcedc service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:14.714861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:14.716204 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:14.716643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:14.717113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] PATH_INFO: `/v3/projects/c87e06e8008d482f9ce39b0136fb11c3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:14.719095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87e06e8008d482f9ce39b0136fb11c3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:14.721121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:14.875815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87e06e8008d482f9ce39b0136fb11c3', 'request_id': 'req-183d4838-d896-4a3e-942f-20ef217dfa47'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.884253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87e06e8008d482f9ce39b0136fb11c3', 'request_id': 'req-183d4838-d896-4a3e-942f-20ef217dfa47'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.892281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87e06e8008d482f9ce39b0136fb11c3', 'request_id': 'req-183d4838-d896-4a3e-942f-20ef217dfa47'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.959528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] The token cache is being invalidate because project c87e06e8008d482f9ce39b0136fb11c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:36:14.959824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.960462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:14.962085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1152/2303] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:36:14 2022] DELETE /identity/v3/projects/c87e06e8008d482f9ce39b0136fb11c3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:36:24.312535 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:24.956280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:26.568532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:26.570049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:26.648033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419fac4-854d-42f4-86aa-a63085dd4bbe admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:26.706770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:26.707390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:26.707675 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:26.707988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:26.710053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:26.776283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:26.777777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:26.789120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1152/2304] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:33.381629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:33.383304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:33.402608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d4838-d896-4a3e-942f-20ef217dfa47 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:33.406973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:33.408322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:33.408680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:33.409060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:33.410971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:33.496268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:33.499384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:33.509541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:33.512437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:33.519453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1153/2305] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:33.535799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483fab8-73d0-4fea-9f9b-877669a6b289 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:33.542152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:33.543214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:33.543678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:33.544137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:33.559917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:33.563686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:33.583443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1153/2306] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:43.511483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=28 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:43.572310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=74 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:43.891507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:43.893273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:43.970050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93683e-3998-44a1-a520-ac86ffe9ae41 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:43.975236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b8e59-ac7f-42e4-8d11-dff2397724e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:43.976653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8e59-ac7f-42e4-8d11-dff2397724e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:43.977208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8e59-ac7f-42e4-8d11-dff2397724e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:43.977727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b8e59-ac7f-42e4-8d11-dff2397724e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:43.981279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-466b8e59-ac7f-42e4-8d11-dff2397724e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:44.001153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b8e59-ac7f-42e4-8d11-dff2397724e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:44.011508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b8e59-ac7f-42e4-8d11-dff2397724e0 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:44.022481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1154/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:49.879064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:49.880546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:49.974739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e6b0d-2f26-4092-847b-3ea82faa28f1 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:49.987524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48d08f-10d7-4e8b-8ed4-7cb573876bbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:49.988794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d08f-10d7-4e8b-8ed4-7cb573876bbb service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:49.989896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d08f-10d7-4e8b-8ed4-7cb573876bbb service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:49.989896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48d08f-10d7-4e8b-8ed4-7cb573876bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:49.993402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6e48d08f-10d7-4e8b-8ed4-7cb573876bbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:49.997673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409888ad-c0dc-4916-a400-3ff5598efecc None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:49.998174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409888ad-c0dc-4916-a400-3ff5598efecc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:49.998651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409888ad-c0dc-4916-a400-3ff5598efecc None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:50.001965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1155/2308] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:36:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:36:50.012868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4c01-e533-4c26-88a4-9c8b45d29b69 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:50.013335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4c01-e533-4c26-88a4-9c8b45d29b69 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:50.013641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4c01-e533-4c26-88a4-9c8b45d29b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:50.043175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-500f4c01-e533-4c26-88a4-9c8b45d29b69 None None] MFA Rules not processed for user `fa7ce8d93f864130a3c079b1aec6b678`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:36:50.044304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-500f4c01-e533-4c26-88a4-9c8b45d29b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:50.053640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1156/2309] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:36:50.080365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48d08f-10d7-4e8b-8ed4-7cb573876bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:50.082381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48d08f-10d7-4e8b-8ed4-7cb573876bbb service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:50.085331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4c01-e533-4c26-88a4-9c8b45d29b69 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:50.086778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-500f4c01-e533-4c26-88a4-9c8b45d29b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:50.096565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1154/2310] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:50.098711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4c01-e533-4c26-88a4-9c8b45d29b69 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:50.103197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be785556-8825-4414-a3fe-bfc5508390aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:50.103825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be785556-8825-4414-a3fe-bfc5508390aa service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:50.105188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be785556-8825-4414-a3fe-bfc5508390aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:50.105188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be785556-8825-4414-a3fe-bfc5508390aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:50.115084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be785556-8825-4414-a3fe-bfc5508390aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:50.116612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be785556-8825-4414-a3fe-bfc5508390aa service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:50.136430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1157/2311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:50.229647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ddc98-1450-4bad-8d9a-7b0e05320f84 None None] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:50.229934 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ddc98-1450-4bad-8d9a-7b0e05320f84 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:50.230214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ddc98-1450-4bad-8d9a-7b0e05320f84 None None] PATH_INFO: `/` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:50.231566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1155/2312] 10.222.0.39 () {54 vars in 921 bytes} [Mon Sep 5 12:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:36:50.240335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747e7af-b6a4-44a1-918f-5026d44e7ee3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:50.242117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747e7af-b6a4-44a1-918f-5026d44e7ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:50.242117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747e7af-b6a4-44a1-918f-5026d44e7ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:50.271344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2747e7af-b6a4-44a1-918f-5026d44e7ee3 None None] MFA Rules not processed for user `2029f59c77de4240a78dba6960735bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:36:50.274347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2747e7af-b6a4-44a1-918f-5026d44e7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:50.301833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1158/2313] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Sep 5 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:36:50.311955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ddc98-1450-4bad-8d9a-7b0e05320f84 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:50.324146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ddc98-1450-4bad-8d9a-7b0e05320f84 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:50.328031 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb2f8b-1283-46f3-a2c4-d141e400d58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:50.329002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb2f8b-1283-46f3-a2c4-d141e400d58c service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:50.329234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb2f8b-1283-46f3-a2c4-d141e400d58c service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:50.329482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb2f8b-1283-46f3-a2c4-d141e400d58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:50.340453 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb2f8b-1283-46f3-a2c4-d141e400d58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:50.341918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb2f8b-1283-46f3-a2c4-d141e400d58c service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:50.354245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1156/2314] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:36:50.478851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747e7af-b6a4-44a1-918f-5026d44e7ee3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:50.480305 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2747e7af-b6a4-44a1-918f-5026d44e7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:50.555504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747e7af-b6a4-44a1-918f-5026d44e7ee3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:50.561130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:50.561749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:50.562063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:50.562359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:50.565769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:50.580182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:50.581817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:50.592407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1159/2315] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:50.597688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7e02a-5cb4-440a-9188-34988ea799cf None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:50.597978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7e02a-5cb4-440a-9188-34988ea799cf None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:50.598279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7e02a-5cb4-440a-9188-34988ea799cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:50.620047 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7dc7e02a-5cb4-440a-9188-34988ea799cf None None] MFA Rules not processed for user `4ac91d9adcf244a6bc7de4a98c565de8`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:36:50.621580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7dc7e02a-5cb4-440a-9188-34988ea799cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:50.628778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1157/2316] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:36:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:36:50.995067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:51.009304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06d73e-4a84-4836-b9fb-bd16081311b7 service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:51.011539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:51.012345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:51.012634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:51.012911 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:51.014987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:51.027148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:51.028649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:51.037970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1160/2317] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:53.217403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7e02a-5cb4-440a-9188-34988ea799cf None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:53.250793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7e02a-5cb4-440a-9188-34988ea799cf None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:53.259194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:53.259709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:53.259995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:53.260340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:53.262280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:53.283758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:53.285607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:53.305248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1158/2318] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:36:54.917752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:54.928649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a6f73-abd7-4432-9bde-b2bd4fc93aee service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:54.934040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:54.935049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:54.935495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:54.935959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:54.942251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:55.025767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:55.040732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:55.042199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:55.054241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1161/2319] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:36:59.550285 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:36:59.551946 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:36:59.570953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13c711-6889-4caf-a8c5-45d2f94a7531 service nova] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:36:59.576805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:36:59.577499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:36:59.577783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:36:59.578060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] PATH_INFO: `/v3/users/567ad9bf5078478a9ef462229bf7f930` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:36:59.579240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567ad9bf5078478a9ef462229bf7f930)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:36:59.581284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:36:59.795436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567ad9bf5078478a9ef462229bf7f930'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:59.796563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567ad9bf5078478a9ef462229bf7f930'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:59.866257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567ad9bf5078478a9ef462229bf7f930'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:59.878582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:36:59.889726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567ad9bf5078478a9ef462229bf7f930'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:59.903078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f10cdc47-44d4-42a8-8186-72105727f571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567ad9bf5078478a9ef462229bf7f930'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:36:59.905273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1159/2320] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:36:59 2022] DELETE /identity/v3/users/567ad9bf5078478a9ef462229bf7f930 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:37:00.206046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:00.216483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a1277-28c7-4465-86b3-19758e3b7a00 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:00.276664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:00.277334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:00.277625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:00.277905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] PATH_INFO: `/v3/projects/a14e33a296124e78ac235d76b5aa9d06` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:00.279044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14e33a296124e78ac235d76b5aa9d06)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:00.281011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:00.404138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14e33a296124e78ac235d76b5aa9d06', 'request_id': 'req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:00.410579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14e33a296124e78ac235d76b5aa9d06', 'request_id': 'req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:00.416192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14e33a296124e78ac235d76b5aa9d06', 'request_id': 'req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:00.507222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] The token cache is being invalidate because project a14e33a296124e78ac235d76b5aa9d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:37:00.507517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:00.508152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c254fd14-4965-4ae2-b1d4-1ceb07e6b29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:00.509715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1162/2321] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:37:00 2022] DELETE /identity/v3/projects/a14e33a296124e78ac235d76b5aa9d06 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:00.514768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcefa28-0407-4775-8eeb-f3c7fdbbcca4 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:00.515060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcefa28-0407-4775-8eeb-f3c7fdbbcca4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:00.515337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcefa28-0407-4775-8eeb-f3c7fdbbcca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:00.535108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-9fcefa28-0407-4775-8eeb-f3c7fdbbcca4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:00.536309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9fcefa28-0407-4775-8eeb-f3c7fdbbcca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:00.595776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1160/2322] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:00.603495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4e2d-5bf2-46c4-aaf1-0e592749274d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:00.603790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4e2d-5bf2-46c4-aaf1-0e592749274d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:00.604061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4e2d-5bf2-46c4-aaf1-0e592749274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:00.625660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-611e4e2d-5bf2-46c4-aaf1-0e592749274d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:00.626858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-611e4e2d-5bf2-46c4-aaf1-0e592749274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:00.634606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1163/2323] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:00.638793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcefa28-0407-4775-8eeb-f3c7fdbbcca4 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:00.648505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcefa28-0407-4775-8eeb-f3c7fdbbcca4 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:00.653282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:00.653887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:00.654172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:00.654449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:00.655110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:37:00.655434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:00.657067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:00.668660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1161/2324] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:37:00.674097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4e2d-5bf2-46c4-aaf1-0e592749274d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:00.684105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4e2d-5bf2-46c4-aaf1-0e592749274d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:00.690138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0e13c-f8ce-436a-9165-d6fb24a61f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:00.691754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e13c-f8ce-436a-9165-d6fb24a61f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:00.691754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e13c-f8ce-436a-9165-d6fb24a61f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:00.691754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e13c-f8ce-436a-9165-d6fb24a61f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:00.692083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e13c-f8ce-436a-9165-d6fb24a61f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:00.693993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e13c-f8ce-436a-9165-d6fb24a61f85 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:00.824309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1164/2325] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:00 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:00.828354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:00.839740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbbdfa-1d4c-4a38-ac46-1fc3e900daba admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:00.907221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021940-ecbb-419f-bbcf-dad547a104b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:00.907867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021940-ecbb-419f-bbcf-dad547a104b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:00.908151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021940-ecbb-419f-bbcf-dad547a104b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:00.908429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021940-ecbb-419f-bbcf-dad547a104b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:00.909123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021940-ecbb-419f-bbcf-dad547a104b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:00.911111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021940-ecbb-419f-bbcf-dad547a104b6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:01.015437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1162/2326] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:00 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:01.021741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0e13c-f8ce-436a-9165-d6fb24a61f85 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:01.038634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0e13c-f8ce-436a-9165-d6fb24a61f85 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:01.043978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaca3d-f232-41c8-8fee-17b36944002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:01.044844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaca3d-f232-41c8-8fee-17b36944002f admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:01.045243 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaca3d-f232-41c8-8fee-17b36944002f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:01.045587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaca3d-f232-41c8-8fee-17b36944002f admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:01.047174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaca3d-f232-41c8-8fee-17b36944002f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:01.049265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfaca3d-f232-41c8-8fee-17b36944002f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:01.064883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1165/2327] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:01.067877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021940-ecbb-419f-bbcf-dad547a104b6 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:01.083728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021940-ecbb-419f-bbcf-dad547a104b6 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:01.093638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1f3e8-1b24-4716-b033-fe6d0e8656e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:01.095356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1f3e8-1b24-4716-b033-fe6d0e8656e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:01.096012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1f3e8-1b24-4716-b033-fe6d0e8656e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:01.096994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1f3e8-1b24-4716-b033-fe6d0e8656e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:01.098372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1f3e8-1b24-4716-b033-fe6d0e8656e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:01.101399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1f3e8-1b24-4716-b033-fe6d0e8656e6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:01.118634 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1163/2328] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:01.123158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaca3d-f232-41c8-8fee-17b36944002f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:01.135035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfaca3d-f232-41c8-8fee-17b36944002f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:01.140709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:01.141693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:01.141933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:01.142184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] PATH_INFO: `/v3/projects/77b0a685bada42778cabc719e9fc980f/users/1742bbf57f6943959961df94f8d9ca19/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:01.166221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b0a685bada42778cabc719e9fc980f, user_id=1742bbf57f6943959961df94f8d9ca19, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:01.174478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:01.258139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1166/2329] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:01 2022] PUT /identity/v3/projects/77b0a685bada42778cabc719e9fc980f/users/1742bbf57f6943959961df94f8d9ca19/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:01.270050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb483-b9fc-422f-b49a-452c18032b8b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:01.270380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb483-b9fc-422f-b49a-452c18032b8b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:01.270600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb483-b9fc-422f-b49a-452c18032b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:01.310721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c7bcb483-b9fc-422f-b49a-452c18032b8b None None] MFA Rules not processed for user `1742bbf57f6943959961df94f8d9ca19`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:01.312993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c7bcb483-b9fc-422f-b49a-452c18032b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:01.357049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:01.403640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1164/2330] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:01.420070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:01.421958 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:01.438260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:01.488813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61a1ca-882c-4d44-baab-2e623292e246 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:01.493152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba65ca-04ff-4817-a295-c7bbfa47d006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:01.496142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba65ca-04ff-4817-a295-c7bbfa47d006 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:01.496426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba65ca-04ff-4817-a295-c7bbfa47d006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:01.496699 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba65ca-04ff-4817-a295-c7bbfa47d006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:01.507053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba65ca-04ff-4817-a295-c7bbfa47d006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:01.508497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba65ca-04ff-4817-a295-c7bbfa47d006 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:01.518513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1167/2331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:03.365445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcb483-b9fc-422f-b49a-452c18032b8b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:03.366987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c7bcb483-b9fc-422f-b49a-452c18032b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:03.468065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcb483-b9fc-422f-b49a-452c18032b8b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:03.475701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:03.476645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:03.479805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:03.480206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:03.482479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:03.497240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:03.500807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:03.517869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1165/2332] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:07.303717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba65ca-04ff-4817-a295-c7bbfa47d006 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:07.324543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba65ca-04ff-4817-a295-c7bbfa47d006 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:07.333849 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:07.334971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:07.335514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:07.336059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:07.338909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:07.358685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:07.360827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:07.372250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1168/2333] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:08.316026 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:08.317579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:08.334592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5eadb-38c9-4e87-9fad-0ef5bd3d7315 service nova] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:08.340072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bfe01-0284-4767-85ce-7af373d4e444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:08.340753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bfe01-0284-4767-85ce-7af373d4e444 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:08.341063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bfe01-0284-4767-85ce-7af373d4e444 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:08.341383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bfe01-0284-4767-85ce-7af373d4e444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:08.344374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-265bfe01-0284-4767-85ce-7af373d4e444 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:08.406974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bfe01-0284-4767-85ce-7af373d4e444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:08.408620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bfe01-0284-4767-85ce-7af373d4e444 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:08.417943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1166/2334] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:11.741473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:11.822555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9d23-dfd7-4edd-93d7-bc834cb6cae5 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:11.827136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:11.828309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:11.828595 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:11.828868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] PATH_INFO: `/v3/users/1742bbf57f6943959961df94f8d9ca19` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:11.830057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1742bbf57f6943959961df94f8d9ca19)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:11.832081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:11.996066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1742bbf57f6943959961df94f8d9ca19'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:11.996725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1742bbf57f6943959961df94f8d9ca19'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.054851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1742bbf57f6943959961df94f8d9ca19'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.055473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1742bbf57f6943959961df94f8d9ca19'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.069802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1742bbf57f6943959961df94f8d9ca19'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.083795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1169/2335] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:37:11 2022] DELETE /identity/v3/users/1742bbf57f6943959961df94f8d9ca19 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:12.089152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec57e-c3e3-4003-a3a7-bd7a1af2dde7 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:12.089688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec57e-c3e3-4003-a3a7-bd7a1af2dde7 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:12.089806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec57e-c3e3-4003-a3a7-bd7a1af2dde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:12.112387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b8fec57e-c3e3-4003-a3a7-bd7a1af2dde7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:12.113653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b8fec57e-c3e3-4003-a3a7-bd7a1af2dde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:12.166457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:12.178135 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1167/2336] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:12.188767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:12.190238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:12.217367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:12.247873 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c6e8f-23ec-4a73-9603-4cfcf8c7643b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:12.252234 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a6438-e34c-4f1d-8a44-88ba848e7617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:12.252837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6438-e34c-4f1d-8a44-88ba848e7617 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:12.253254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6438-e34c-4f1d-8a44-88ba848e7617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:12.253789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6438-e34c-4f1d-8a44-88ba848e7617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:12.264015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a6438-e34c-4f1d-8a44-88ba848e7617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:12.278005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a6438-e34c-4f1d-8a44-88ba848e7617 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:12.278005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1170/2337] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:12.699924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec57e-c3e3-4003-a3a7-bd7a1af2dde7 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:12.701664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b8fec57e-c3e3-4003-a3a7-bd7a1af2dde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:12.721043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec57e-c3e3-4003-a3a7-bd7a1af2dde7 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:12.726360 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:12.727111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:12.727549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:12.727827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] PATH_INFO: `/v3/projects/77b0a685bada42778cabc719e9fc980f` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:12.729051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b0a685bada42778cabc719e9fc980f)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:12.733609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:12.845306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b0a685bada42778cabc719e9fc980f', 'request_id': 'req-14fe133f-ef7c-4b7c-80e0-8337a39cc531'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.852484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b0a685bada42778cabc719e9fc980f', 'request_id': 'req-14fe133f-ef7c-4b7c-80e0-8337a39cc531'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.859016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b0a685bada42778cabc719e9fc980f', 'request_id': 'req-14fe133f-ef7c-4b7c-80e0-8337a39cc531'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.934644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] The token cache is being invalidate because project 77b0a685bada42778cabc719e9fc980f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:37:12.934929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.935564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-14fe133f-ef7c-4b7c-80e0-8337a39cc531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:12.937680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1168/2338] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:37:12 2022] DELETE /identity/v3/projects/77b0a685bada42778cabc719e9fc980f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:12.942740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add32fe-dd59-4a5f-8fbf-c7f3ceae5b26 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:12.943240 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add32fe-dd59-4a5f-8fbf-c7f3ceae5b26 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:12.943350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add32fe-dd59-4a5f-8fbf-c7f3ceae5b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:12.963954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7add32fe-dd59-4a5f-8fbf-c7f3ceae5b26 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:12.965207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7add32fe-dd59-4a5f-8fbf-c7f3ceae5b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:13.025490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1171/2339] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:37:13.033222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9d225-cd5a-46ec-818b-90a37b49b466 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.033515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9d225-cd5a-46ec-818b-90a37b49b466 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.033794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9d225-cd5a-46ec-818b-90a37b49b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.053788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-cfa9d225-cd5a-46ec-818b-90a37b49b466 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:13.054938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-cfa9d225-cd5a-46ec-818b-90a37b49b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:13.063663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1169/2340] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:13.076366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add32fe-dd59-4a5f-8fbf-c7f3ceae5b26 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:13.086738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add32fe-dd59-4a5f-8fbf-c7f3ceae5b26 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:13.091637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:13.092275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.092559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.092837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.093540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:37:13.093847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:13.095440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:13.107464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1172/2341] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:37:13.111835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9d225-cd5a-46ec-818b-90a37b49b466 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:13.121307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9d225-cd5a-46ec-818b-90a37b49b466 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:13.126954 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17310ef-cd51-475c-872b-5e008919ca7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:13.127685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17310ef-cd51-475c-872b-5e008919ca7a admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.128066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17310ef-cd51-475c-872b-5e008919ca7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.128460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17310ef-cd51-475c-872b-5e008919ca7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.129312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17310ef-cd51-475c-872b-5e008919ca7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:13.131686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17310ef-cd51-475c-872b-5e008919ca7a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:13.216604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1170/2342] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:13 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:37:13.231862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:13.231862 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b03bd-f57f-44c1-a9c0-2dcb38ccf4df admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:13.291412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44be8c2-0459-42ef-a15b-8388122cc568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:13.292016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44be8c2-0459-42ef-a15b-8388122cc568 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.292299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44be8c2-0459-42ef-a15b-8388122cc568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.292570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44be8c2-0459-42ef-a15b-8388122cc568 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.293274 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44be8c2-0459-42ef-a15b-8388122cc568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:13.295214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44be8c2-0459-42ef-a15b-8388122cc568 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:13.412377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1173/2343] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:13 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:37:13.413615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17310ef-cd51-475c-872b-5e008919ca7a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:13.425450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17310ef-cd51-475c-872b-5e008919ca7a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:13.430257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae104d7-0958-48ae-b53f-df81a1c38494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:13.431155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae104d7-0958-48ae-b53f-df81a1c38494 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.434132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae104d7-0958-48ae-b53f-df81a1c38494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.434132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae104d7-0958-48ae-b53f-df81a1c38494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.434132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae104d7-0958-48ae-b53f-df81a1c38494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:13.434132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae104d7-0958-48ae-b53f-df81a1c38494 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:13.445765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1171/2344] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:13.450181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44be8c2-0459-42ef-a15b-8388122cc568 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:13.460759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44be8c2-0459-42ef-a15b-8388122cc568 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:13.465256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ebe3a-4aa5-41da-b265-910f0a5931cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:13.465863 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebe3a-4aa5-41da-b265-910f0a5931cd admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.466145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebe3a-4aa5-41da-b265-910f0a5931cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.466418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ebe3a-4aa5-41da-b265-910f0a5931cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.467075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ebe3a-4aa5-41da-b265-910f0a5931cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:13.468706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ebe3a-4aa5-41da-b265-910f0a5931cd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:13.479842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1174/2345] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:37:13.484558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae104d7-0958-48ae-b53f-df81a1c38494 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:13.494763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae104d7-0958-48ae-b53f-df81a1c38494 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:13.500597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:13.501277 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.501558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.501861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] PATH_INFO: `/v3/projects/0773e4b8c142473aac6e9ca05ec09a8e/users/57a03759e4a448b5a5cbe12912a6753d/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.516828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0773e4b8c142473aac6e9ca05ec09a8e, user_id=57a03759e4a448b5a5cbe12912a6753d, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:13.519669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:13.610713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1172/2346] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:13 2022] PUT /identity/v3/projects/0773e4b8c142473aac6e9ca05ec09a8e/users/57a03759e4a448b5a5cbe12912a6753d/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:13.616014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c3b15-dcae-442b-872f-4297bb95cede None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.616420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c3b15-dcae-442b-872f-4297bb95cede None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.616727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c3b15-dcae-442b-872f-4297bb95cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.636718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-217c3b15-dcae-442b-872f-4297bb95cede None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:13.637974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-217c3b15-dcae-442b-872f-4297bb95cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:13.665166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:13.703682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1175/2347] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:13.711134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:13.712938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:13.773223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30cfb6-92aa-411d-8ea5-88d822118bfc admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:13.776878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e4e7d-b983-4968-9b8a-2d66e208acef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:13.777515 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e4e7d-b983-4968-9b8a-2d66e208acef service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:13.777796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e4e7d-b983-4968-9b8a-2d66e208acef service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:13.778093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e4e7d-b983-4968-9b8a-2d66e208acef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:13.787755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e4e7d-b983-4968-9b8a-2d66e208acef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:13.789215 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e4e7d-b983-4968-9b8a-2d66e208acef service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:13.799507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1173/2348] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:15.296796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db095979-f0e9-4f7e-9dab-a65ada278820 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:15.297347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db095979-f0e9-4f7e-9dab-a65ada278820 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:15.297472 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db095979-f0e9-4f7e-9dab-a65ada278820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:15.328814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-db095979-f0e9-4f7e-9dab-a65ada278820 None None] MFA Rules not processed for user `57a03759e4a448b5a5cbe12912a6753d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:15.330054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-db095979-f0e9-4f7e-9dab-a65ada278820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:15.399810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1176/2349] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:15.404506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e4e7d-b983-4968-9b8a-2d66e208acef service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:15.416937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e4e7d-b983-4968-9b8a-2d66e208acef service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:15.422528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b49c4-811d-4360-8698-6427aabe14e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:15.423351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b49c4-811d-4360-8698-6427aabe14e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:15.423641 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b49c4-811d-4360-8698-6427aabe14e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:15.423919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b49c4-811d-4360-8698-6427aabe14e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:15.424558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b49c4-811d-4360-8698-6427aabe14e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:15.426709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b49c4-811d-4360-8698-6427aabe14e6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:15.442930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:15.552815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1174/2350] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:15 2022] POST /identity/v3/projects => generated 403 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:15.554791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db095979-f0e9-4f7e-9dab-a65ada278820 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:15.567124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db095979-f0e9-4f7e-9dab-a65ada278820 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:15.626778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943e48a-2cdf-4f6b-88f4-49fbfee41ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:15.627421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e48a-2cdf-4f6b-88f4-49fbfee41ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:15.627784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e48a-2cdf-4f6b-88f4-49fbfee41ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:15.628064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943e48a-2cdf-4f6b-88f4-49fbfee41ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:15.628710 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943e48a-2cdf-4f6b-88f4-49fbfee41ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:15.630701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943e48a-2cdf-4f6b-88f4-49fbfee41ae3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:15.712541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1177/2351] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:15 2022] POST /identity/v3/users => generated 308 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:37:15.716550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b49c4-811d-4360-8698-6427aabe14e6 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:15.727587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b49c4-811d-4360-8698-6427aabe14e6 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:15.732262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e2164-f89a-4239-805f-150437ffd815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:15.732873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e2164-f89a-4239-805f-150437ffd815 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:15.733184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e2164-f89a-4239-805f-150437ffd815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:15.733559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e2164-f89a-4239-805f-150437ffd815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:15.734865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e2164-f89a-4239-805f-150437ffd815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:15.736498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e2164-f89a-4239-805f-150437ffd815 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:15.748424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1175/2352] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:15.752643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943e48a-2cdf-4f6b-88f4-49fbfee41ae3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:15.763224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943e48a-2cdf-4f6b-88f4-49fbfee41ae3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:15.768890 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654418f-9836-4d8d-ae08-3b9035098975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:15.770036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654418f-9836-4d8d-ae08-3b9035098975 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:15.770036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654418f-9836-4d8d-ae08-3b9035098975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:15.770400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654418f-9836-4d8d-ae08-3b9035098975 admin admin] PATH_INFO: `/v3/projects/0b7d6c7e31634edeb9d1a4870a925cbd/users/0c2d658e72f544d0ab7cc338145d7bb5/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:15.786441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654418f-9836-4d8d-ae08-3b9035098975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7d6c7e31634edeb9d1a4870a925cbd, user_id=0c2d658e72f544d0ab7cc338145d7bb5, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:15.789133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654418f-9836-4d8d-ae08-3b9035098975 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:15.907152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1178/2353] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:15 2022] PUT /identity/v3/projects/0b7d6c7e31634edeb9d1a4870a925cbd/users/0c2d658e72f544d0ab7cc338145d7bb5/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:15.911471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e2164-f89a-4239-805f-150437ffd815 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:15.922905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e2164-f89a-4239-805f-150437ffd815 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:15.988295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a3012-ecff-4307-9eff-f28b63135d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:15.988928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a3012-ecff-4307-9eff-f28b63135d76 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:15.989238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a3012-ecff-4307-9eff-f28b63135d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:15.989508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a3012-ecff-4307-9eff-f28b63135d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:15.990145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a3012-ecff-4307-9eff-f28b63135d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:15.991762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a3012-ecff-4307-9eff-f28b63135d76 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:16.001637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1176/2354] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:16.006791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654418f-9836-4d8d-ae08-3b9035098975 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:16.019753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654418f-9836-4d8d-ae08-3b9035098975 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:16.025810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:16.026483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:16.026767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:16.027075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] PATH_INFO: `/v3/projects/0b7d6c7e31634edeb9d1a4870a925cbd/users/0c2d658e72f544d0ab7cc338145d7bb5/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:16.029530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7d6c7e31634edeb9d1a4870a925cbd, user_id=0c2d658e72f544d0ab7cc338145d7bb5, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:16.032615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:16.045956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1179/2355] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:16 2022] PUT /identity/v3/projects/0b7d6c7e31634edeb9d1a4870a925cbd/users/0c2d658e72f544d0ab7cc338145d7bb5/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:16.722096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ed27e-3992-4c0a-a99f-3624fc9233d8 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:16.722990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ed27e-3992-4c0a-a99f-3624fc9233d8 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:16.723275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ed27e-3992-4c0a-a99f-3624fc9233d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:16.743753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-633ed27e-3992-4c0a-a99f-3624fc9233d8 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:16.744972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-633ed27e-3992-4c0a-a99f-3624fc9233d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:16.804306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1177/2356] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:37:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:16.939973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:16.944184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:16.960226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:17.015611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5445c22-9186-4485-a76d-7988433add2d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:17.020798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4082b49-69c2-4127-8da2-dd93e7293fe1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:17.021452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082b49-69c2-4127-8da2-dd93e7293fe1 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:17.021735 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082b49-69c2-4127-8da2-dd93e7293fe1 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:17.022011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082b49-69c2-4127-8da2-dd93e7293fe1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:17.031387 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4082b49-69c2-4127-8da2-dd93e7293fe1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:17.033029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4082b49-69c2-4127-8da2-dd93e7293fe1 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:17.042150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1180/2357] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:37:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:37:17.121028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93284-f20f-4656-ac92-d5cd27d3f2b9 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:17.181265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93284-f20f-4656-ac92-d5cd27d3f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:17.181265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd93284-f20f-4656-ac92-d5cd27d3f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:17.181265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7cd93284-f20f-4656-ac92-d5cd27d3f2b9 None None] MFA Rules not processed for user `0c2d658e72f544d0ab7cc338145d7bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:17.181265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7cd93284-f20f-4656-ac92-d5cd27d3f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:17.261937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1178/2358] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:19.231788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4082b49-69c2-4127-8da2-dd93e7293fe1 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:19.317512 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4082b49-69c2-4127-8da2-dd93e7293fe1 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:19.332973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:19.332973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:19.332973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:19.332973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] PATH_INFO: `/v3/users/57a03759e4a448b5a5cbe12912a6753d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:19.333427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a03759e4a448b5a5cbe12912a6753d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:19.333427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:19.564938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a03759e4a448b5a5cbe12912a6753d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:19.565610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a03759e4a448b5a5cbe12912a6753d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:19.666519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a03759e4a448b5a5cbe12912a6753d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:19.673245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a03759e4a448b5a5cbe12912a6753d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:19.700638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a03759e4a448b5a5cbe12912a6753d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:19.721914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1181/2359] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:37:19 2022] DELETE /identity/v3/users/57a03759e4a448b5a5cbe12912a6753d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:20.077262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd93284-f20f-4656-ac92-d5cd27d3f2b9 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:20.096452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd93284-f20f-4656-ac92-d5cd27d3f2b9 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:20.121815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:20.224749 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:20.225768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:20.226082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:20.227231 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] PATH_INFO: `/v3/projects/0773e4b8c142473aac6e9ca05ec09a8e` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:20.228980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0773e4b8c142473aac6e9ca05ec09a8e)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:20.233450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:20.464681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0773e4b8c142473aac6e9ca05ec09a8e', 'request_id': 'req-84a7473b-27e2-4059-8ea8-152b1db76145'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:20.473144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0773e4b8c142473aac6e9ca05ec09a8e', 'request_id': 'req-84a7473b-27e2-4059-8ea8-152b1db76145'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:20.479105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0773e4b8c142473aac6e9ca05ec09a8e', 'request_id': 'req-84a7473b-27e2-4059-8ea8-152b1db76145'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:20.581837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] The token cache is being invalidate because project 0773e4b8c142473aac6e9ca05ec09a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:37:20.582132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:20.582893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:20.587169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1179/2360] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:37:20 2022] DELETE /identity/v3/projects/0773e4b8c142473aac6e9ca05ec09a8e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:20.590132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:20.591648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:20.608879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1a2db-5930-4f5c-8d10-5d9fb0de31db admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:20.633954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:20.684786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:20.685606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:20.685970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:20.686321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] PATH_INFO: `/v3/users/0c2d658e72f544d0ab7cc338145d7bb5` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:20.688090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2d658e72f544d0ab7cc338145d7bb5)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:20.690311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:20.961597 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2d658e72f544d0ab7cc338145d7bb5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:20.963057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2d658e72f544d0ab7cc338145d7bb5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.037551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2d658e72f544d0ab7cc338145d7bb5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.038262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2d658e72f544d0ab7cc338145d7bb5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.057221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8f0b9361-023f-4bd1-9f42-c516be0d413e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2d658e72f544d0ab7cc338145d7bb5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.075311 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1182/2361] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:37:20 2022] DELETE /identity/v3/users/0c2d658e72f544d0ab7cc338145d7bb5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:21.421379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:21.426791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:21.527345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7473b-27e2-4059-8ea8-152b1db76145 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:21.646326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:21.647286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:21.647805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:21.648299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] PATH_INFO: `/v3/projects/0b7d6c7e31634edeb9d1a4870a925cbd` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:21.650351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7d6c7e31634edeb9d1a4870a925cbd)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:21.652734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:21.844915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:21.849791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7d6c7e31634edeb9d1a4870a925cbd', 'request_id': 'req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.860264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7d6c7e31634edeb9d1a4870a925cbd', 'request_id': 'req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.875282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7d6c7e31634edeb9d1a4870a925cbd', 'request_id': 'req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.981527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] The token cache is being invalidate because project 0b7d6c7e31634edeb9d1a4870a925cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:37:21.981808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.982498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-6309b3b7-4904-422b-9b50-cc9d9bc17d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:21.988239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1180/2362] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:37:21 2022] DELETE /identity/v3/projects/0b7d6c7e31634edeb9d1a4870a925cbd => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:21.990685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2f2e-6a29-4bf2-a549-69c6a53966d3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:21.991474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2f2e-6a29-4bf2-a549-69c6a53966d3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:21.991621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2f2e-6a29-4bf2-a549-69c6a53966d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.013141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-193d2f2e-6a29-4bf2-a549-69c6a53966d3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:22.016447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-193d2f2e-6a29-4bf2-a549-69c6a53966d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:22.109266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1183/2363] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:22.116938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690b6d6-ff6d-4a84-8d9c-a736b7fbe80d None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:22.117537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690b6d6-ff6d-4a84-8d9c-a736b7fbe80d None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:22.117985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690b6d6-ff6d-4a84-8d9c-a736b7fbe80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.152065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a690b6d6-ff6d-4a84-8d9c-a736b7fbe80d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:22.155605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a690b6d6-ff6d-4a84-8d9c-a736b7fbe80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:22.165046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1181/2364] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:22.169411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d2f2e-6a29-4bf2-a549-69c6a53966d3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:22.181870 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d2f2e-6a29-4bf2-a549-69c6a53966d3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:22.186982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:22.188132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:22.188425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:22.188674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.189360 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:37:22.189662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:22.193239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:22.210306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1184/2365] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:37:22.214369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690b6d6-ff6d-4a84-8d9c-a736b7fbe80d None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:22.224763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690b6d6-ff6d-4a84-8d9c-a736b7fbe80d None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:22.229715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40b5a8-5596-4bb8-b486-8653f16a060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:22.230346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b5a8-5596-4bb8-b486-8653f16a060c admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:22.230714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b5a8-5596-4bb8-b486-8653f16a060c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:22.230992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b5a8-5596-4bb8-b486-8653f16a060c admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.231680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40b5a8-5596-4bb8-b486-8653f16a060c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:22.233678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40b5a8-5596-4bb8-b486-8653f16a060c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:22.350279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:22.355892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1182/2366] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:22 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:22.362187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f5a8-4173-4f7c-8c76-5f351a23ab03 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:22.401861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:22.456343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0449d2c-16e4-4683-ad86-1adf188bc313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:22.457238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0449d2c-16e4-4683-ad86-1adf188bc313 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:22.457598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0449d2c-16e4-4683-ad86-1adf188bc313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:22.457940 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0449d2c-16e4-4683-ad86-1adf188bc313 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.458648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0449d2c-16e4-4683-ad86-1adf188bc313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:22.461690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0449d2c-16e4-4683-ad86-1adf188bc313 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:22.594765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1185/2367] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:22 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:22.599547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40b5a8-5596-4bb8-b486-8653f16a060c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:22.614474 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40b5a8-5596-4bb8-b486-8653f16a060c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:22.629046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70cccd-c6d8-464a-92b4-02cae3841929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:22.629957 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70cccd-c6d8-464a-92b4-02cae3841929 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:22.630251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70cccd-c6d8-464a-92b4-02cae3841929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:22.630528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70cccd-c6d8-464a-92b4-02cae3841929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.631455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70cccd-c6d8-464a-92b4-02cae3841929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:22.633252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70cccd-c6d8-464a-92b4-02cae3841929 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:22.653942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1183/2368] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:22.660236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0449d2c-16e4-4683-ad86-1adf188bc313 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:22.674007 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0449d2c-16e4-4683-ad86-1adf188bc313 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:22.686981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbf257-9a37-46dc-9d96-10e1d01a1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:22.687793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbf257-9a37-46dc-9d96-10e1d01a1052 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:22.688082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbf257-9a37-46dc-9d96-10e1d01a1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:22.688357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbf257-9a37-46dc-9d96-10e1d01a1052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.689086 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbf257-9a37-46dc-9d96-10e1d01a1052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:22.692470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbf257-9a37-46dc-9d96-10e1d01a1052 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:22.715866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1186/2369] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:22.720731 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70cccd-c6d8-464a-92b4-02cae3841929 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:22.731693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70cccd-c6d8-464a-92b4-02cae3841929 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:22.742421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:22.743381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:22.743777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:22.744216 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] PATH_INFO: `/v3/projects/7041c1a49efa446abd82db109d33fba4/users/f259a5ece5e34146a633644f3bcc738c/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.763950 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7041c1a49efa446abd82db109d33fba4, user_id=f259a5ece5e34146a633644f3bcc738c, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:22.767656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:22.842798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1184/2370] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:22 2022] PUT /identity/v3/projects/7041c1a49efa446abd82db109d33fba4/users/f259a5ece5e34146a633644f3bcc738c/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:22.848601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df768e-60bf-44cf-84b7-4a7a94904f4a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:22.848823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df768e-60bf-44cf-84b7-4a7a94904f4a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:22.849270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df768e-60bf-44cf-84b7-4a7a94904f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:22.873523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-75df768e-60bf-44cf-84b7-4a7a94904f4a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:22.875486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-75df768e-60bf-44cf-84b7-4a7a94904f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:22.957336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1187/2371] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:22.967972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:22.969883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:23.044275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b153-63cd-43b1-bd04-aa085e21ab94 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:23.053670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e36e69-a23c-44d8-bdd6-4e914057ce51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:23.054342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e36e69-a23c-44d8-bdd6-4e914057ce51 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:23.054621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e36e69-a23c-44d8-bdd6-4e914057ce51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:23.054904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e36e69-a23c-44d8-bdd6-4e914057ce51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:23.073167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e36e69-a23c-44d8-bdd6-4e914057ce51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:23.075062 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e36e69-a23c-44d8-bdd6-4e914057ce51 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:23.089610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1185/2372] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:25.152772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7185f1-7741-4a75-b5fe-03a91dbe6d8d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:25.152772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7185f1-7741-4a75-b5fe-03a91dbe6d8d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:25.152772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7185f1-7741-4a75-b5fe-03a91dbe6d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:25.244996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4d7185f1-7741-4a75-b5fe-03a91dbe6d8d None None] MFA Rules not processed for user `f259a5ece5e34146a633644f3bcc738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:25.244996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4d7185f1-7741-4a75-b5fe-03a91dbe6d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:25.377655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1188/2373] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:37:25.379785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e36e69-a23c-44d8-bdd6-4e914057ce51 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:25.391154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e36e69-a23c-44d8-bdd6-4e914057ce51 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:25.397472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6262f-2087-4d6d-8ad7-0b9ca5ac99f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:25.398097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6262f-2087-4d6d-8ad7-0b9ca5ac99f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:25.398383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6262f-2087-4d6d-8ad7-0b9ca5ac99f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:25.398658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6262f-2087-4d6d-8ad7-0b9ca5ac99f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:25.399348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6262f-2087-4d6d-8ad7-0b9ca5ac99f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:25.401295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6262f-2087-4d6d-8ad7-0b9ca5ac99f2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:25.511362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1186/2374] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:25 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:25.513957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7185f1-7741-4a75-b5fe-03a91dbe6d8d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:25.534270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7185f1-7741-4a75-b5fe-03a91dbe6d8d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:25.583982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:25.616709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6584a-61f2-4f79-bf10-f37f51c2dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:25.617369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6584a-61f2-4f79-bf10-f37f51c2dc27 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:25.617652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6584a-61f2-4f79-bf10-f37f51c2dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:25.617928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6584a-61f2-4f79-bf10-f37f51c2dc27 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:25.618577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6584a-61f2-4f79-bf10-f37f51c2dc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:25.620900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6584a-61f2-4f79-bf10-f37f51c2dc27 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:25.730370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6262f-2087-4d6d-8ad7-0b9ca5ac99f2 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:25.737092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1189/2375] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:25 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:25.744642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6262f-2087-4d6d-8ad7-0b9ca5ac99f2 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:25.749346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b9873-a847-4418-9a33-e94c1e879b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:25.750150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9873-a847-4418-9a33-e94c1e879b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:25.750436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9873-a847-4418-9a33-e94c1e879b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:25.750714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b9873-a847-4418-9a33-e94c1e879b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:25.751366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b9873-a847-4418-9a33-e94c1e879b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:25.753007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b9873-a847-4418-9a33-e94c1e879b26 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:25.771648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1187/2376] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:37:25.772991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6584a-61f2-4f79-bf10-f37f51c2dc27 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:25.786513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6584a-61f2-4f79-bf10-f37f51c2dc27 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:25.791553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa4691-a1e5-436f-9b39-4dc974017a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:25.792707 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa4691-a1e5-436f-9b39-4dc974017a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:25.793115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa4691-a1e5-436f-9b39-4dc974017a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:25.793403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa4691-a1e5-436f-9b39-4dc974017a24 admin admin] PATH_INFO: `/v3/projects/95ef8ec448954333be17cfcea51e6de5/users/2e7293b691464881a53ff6c45e4c3f9f/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:25.822890 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa4691-a1e5-436f-9b39-4dc974017a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ef8ec448954333be17cfcea51e6de5, user_id=2e7293b691464881a53ff6c45e4c3f9f, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:25.822890 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa4691-a1e5-436f-9b39-4dc974017a24 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:25.918632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1190/2377] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:25 2022] PUT /identity/v3/projects/95ef8ec448954333be17cfcea51e6de5/users/2e7293b691464881a53ff6c45e4c3f9f/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:25.922832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b9873-a847-4418-9a33-e94c1e879b26 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:25.942202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b9873-a847-4418-9a33-e94c1e879b26 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:25.986670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:26.025604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff8b02-a4f6-4792-ba49-bd4b19bca1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:26.026257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8b02-a4f6-4792-ba49-bd4b19bca1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:26.026510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8b02-a4f6-4792-ba49-bd4b19bca1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:26.026788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff8b02-a4f6-4792-ba49-bd4b19bca1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:26.027489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff8b02-a4f6-4792-ba49-bd4b19bca1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:26.029190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff8b02-a4f6-4792-ba49-bd4b19bca1a7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:26.045546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1188/2378] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:26.045783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa4691-a1e5-436f-9b39-4dc974017a24 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:26.063097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa4691-a1e5-436f-9b39-4dc974017a24 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:26.070175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae7f3-2fd7-4131-9345-1ca75bca13b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:26.071170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae7f3-2fd7-4131-9345-1ca75bca13b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:26.071517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae7f3-2fd7-4131-9345-1ca75bca13b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:26.071863 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae7f3-2fd7-4131-9345-1ca75bca13b0 admin admin] PATH_INFO: `/v3/projects/95ef8ec448954333be17cfcea51e6de5/users/2e7293b691464881a53ff6c45e4c3f9f/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:26.074107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ae7f3-2fd7-4131-9345-1ca75bca13b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ef8ec448954333be17cfcea51e6de5, user_id=2e7293b691464881a53ff6c45e4c3f9f, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:26.079686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ae7f3-2fd7-4131-9345-1ca75bca13b0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:26.095765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1191/2379] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:26 2022] PUT /identity/v3/projects/95ef8ec448954333be17cfcea51e6de5/users/2e7293b691464881a53ff6c45e4c3f9f/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:28.476053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482f797-46a4-45e1-9997-bd034a2c27b3 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:28.476626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482f797-46a4-45e1-9997-bd034a2c27b3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:28.476726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482f797-46a4-45e1-9997-bd034a2c27b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:28.532669 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-9482f797-46a4-45e1-9997-bd034a2c27b3 None None] MFA Rules not processed for user `2e7293b691464881a53ff6c45e4c3f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:28.533855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9482f797-46a4-45e1-9997-bd034a2c27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:28.628325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1189/2380] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:28.642987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24540367-d002-4478-a08f-b768b0321015 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:28.643537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24540367-d002-4478-a08f-b768b0321015 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:28.643537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24540367-d002-4478-a08f-b768b0321015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:28.666236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-24540367-d002-4478-a08f-b768b0321015 None None] MFA Rules not processed for user `f259a5ece5e34146a633644f3bcc738c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:28.667648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-24540367-d002-4478-a08f-b768b0321015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:28.731676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1192/2381] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:28.744025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482f797-46a4-45e1-9997-bd034a2c27b3 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:28.745500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9482f797-46a4-45e1-9997-bd034a2c27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:28.850076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482f797-46a4-45e1-9997-bd034a2c27b3 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:28.857921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be27b66-038a-4e74-b0af-eec7f7e373e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:28.858763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be27b66-038a-4e74-b0af-eec7f7e373e4 service nova] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:28.859048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be27b66-038a-4e74-b0af-eec7f7e373e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:28.859336 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be27b66-038a-4e74-b0af-eec7f7e373e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:28.868481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be27b66-038a-4e74-b0af-eec7f7e373e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:28.870589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be27b66-038a-4e74-b0af-eec7f7e373e4 service nova] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:28.881212 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1190/2382] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:38.420653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24540367-d002-4478-a08f-b768b0321015 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:38.421376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-24540367-d002-4478-a08f-b768b0321015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:38.480060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24540367-d002-4478-a08f-b768b0321015 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:38.483685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:38.484290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:38.484573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:38.484851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:38.486657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:38.538217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:38.553616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:38.555069 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:38.565040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1193/2383] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:38.881370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=80 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:40.478751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe94d3-bd78-4576-9386-f6aaaa2f73ad None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:40.479373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe94d3-bd78-4576-9386-f6aaaa2f73ad None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:40.479373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe94d3-bd78-4576-9386-f6aaaa2f73ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:40.500149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-56fe94d3-bd78-4576-9386-f6aaaa2f73ad None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:40.501416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-56fe94d3-bd78-4576-9386-f6aaaa2f73ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:40.579846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1191/2384] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:37:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:40.592899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:40.594505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:40.680466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d18f8-d2d5-4053-9a36-e9753be8a8f2 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:40.685769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c5453-de1b-451c-9bdd-5fece89a6233 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:40.686434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c5453-de1b-451c-9bdd-5fece89a6233 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:40.686718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c5453-de1b-451c-9bdd-5fece89a6233 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:40.687001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c5453-de1b-451c-9bdd-5fece89a6233 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:40.695535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c5453-de1b-451c-9bdd-5fece89a6233 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:40.697204 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c5453-de1b-451c-9bdd-5fece89a6233 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:40.706836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1194/2385] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:37:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:37:43.122789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe94d3-bd78-4576-9386-f6aaaa2f73ad None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:43.124958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-56fe94d3-bd78-4576-9386-f6aaaa2f73ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:43.145218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe94d3-bd78-4576-9386-f6aaaa2f73ad None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:43.150129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:43.150803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:43.151269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:43.151717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] PATH_INFO: `/v3/users/457d3a58fbd34c2c8d5e082e58b56134` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:43.153355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457d3a58fbd34c2c8d5e082e58b56134)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:43.163629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:43.417614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457d3a58fbd34c2c8d5e082e58b56134'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:43.418295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457d3a58fbd34c2c8d5e082e58b56134'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:43.482438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457d3a58fbd34c2c8d5e082e58b56134'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:43.497521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457d3a58fbd34c2c8d5e082e58b56134'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:43.498297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b6216048-cf60-4136-b97d-567156064db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457d3a58fbd34c2c8d5e082e58b56134'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:43.511538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1192/2386] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:37:43 2022] DELETE /identity/v3/users/457d3a58fbd34c2c8d5e082e58b56134 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:43.765228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c5453-de1b-451c-9bdd-5fece89a6233 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:43.778345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c5453-de1b-451c-9bdd-5fece89a6233 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:43.851346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:43.851999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:43.852444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:43.852725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] PATH_INFO: `/v3/projects/c1776c939a984bd497f613f3b07c1657` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:43.853987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1776c939a984bd497f613f3b07c1657)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:43.855974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:43.970442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1776c939a984bd497f613f3b07c1657', 'request_id': 'req-3140bf70-af94-4c54-9e58-c0b616edb918'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:43.976848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1776c939a984bd497f613f3b07c1657', 'request_id': 'req-3140bf70-af94-4c54-9e58-c0b616edb918'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:43.983466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1776c939a984bd497f613f3b07c1657', 'request_id': 'req-3140bf70-af94-4c54-9e58-c0b616edb918'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:44.068420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] The token cache is being invalidate because project c1776c939a984bd497f613f3b07c1657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:37:44.068624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:44.069313 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3140bf70-af94-4c54-9e58-c0b616edb918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:44.070828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1195/2387] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:37:43 2022] DELETE /identity/v3/projects/c1776c939a984bd497f613f3b07c1657 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:44.082664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750f5d-f4f6-4a93-87ca-b437a5e390e4 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.082960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750f5d-f4f6-4a93-87ca-b437a5e390e4 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.083243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750f5d-f4f6-4a93-87ca-b437a5e390e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.104819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-cb750f5d-f4f6-4a93-87ca-b437a5e390e4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:44.106341 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-cb750f5d-f4f6-4a93-87ca-b437a5e390e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:44.197766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1193/2388] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:44.205915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d7d5-6d2e-456c-8a33-7160b2fa3495 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.206205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d7d5-6d2e-456c-8a33-7160b2fa3495 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.206481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d7d5-6d2e-456c-8a33-7160b2fa3495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.246228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:44.281812 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4c49d7d5-6d2e-456c-8a33-7160b2fa3495 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:44.282998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4c49d7d5-6d2e-456c-8a33-7160b2fa3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:44.295969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1196/2389] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:44.297312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb750f5d-f4f6-4a93-87ca-b437a5e390e4 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:44.308472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb750f5d-f4f6-4a93-87ca-b437a5e390e4 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:44.326304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:44.329662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.329991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.330304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.330970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:37:44.331283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:44.333345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:44.362496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1194/2390] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:37:44.366608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49d7d5-6d2e-456c-8a33-7160b2fa3495 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:44.381003 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49d7d5-6d2e-456c-8a33-7160b2fa3495 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:44.393792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660136-95b9-4e27-b734-886e645db04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:44.394676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660136-95b9-4e27-b734-886e645db04b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.395296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660136-95b9-4e27-b734-886e645db04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.407362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92660136-95b9-4e27-b734-886e645db04b admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.408731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660136-95b9-4e27-b734-886e645db04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:44.415471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92660136-95b9-4e27-b734-886e645db04b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:44.529197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1197/2391] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:44 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:37:44.534108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:44.540779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:44.544898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113c565-248c-4a50-857d-a6a63213c42c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:44.612129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c77d5-a055-4db9-bed0-7058e9e870b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:44.612754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c77d5-a055-4db9-bed0-7058e9e870b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.613117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c77d5-a055-4db9-bed0-7058e9e870b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.613399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c77d5-a055-4db9-bed0-7058e9e870b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.614131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c77d5-a055-4db9-bed0-7058e9e870b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:44.616241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c77d5-a055-4db9-bed0-7058e9e870b3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:44.702385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1195/2392] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:44 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:44.704099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660136-95b9-4e27-b734-886e645db04b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:44.714757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92660136-95b9-4e27-b734-886e645db04b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:44.719606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3ac4-06cf-4d8f-8763-46e275a9d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:44.721466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3ac4-06cf-4d8f-8763-46e275a9d497 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.721466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3ac4-06cf-4d8f-8763-46e275a9d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.721466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc3ac4-06cf-4d8f-8763-46e275a9d497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.721466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc3ac4-06cf-4d8f-8763-46e275a9d497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:44.723053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc3ac4-06cf-4d8f-8763-46e275a9d497 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:44.736987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1198/2393] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:37:44.738340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c77d5-a055-4db9-bed0-7058e9e870b3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:44.748933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c77d5-a055-4db9-bed0-7058e9e870b3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:44.754605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eb10f-45c8-401d-9bd0-a90f4a727851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:44.755225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb10f-45c8-401d-9bd0-a90f4a727851 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.755501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb10f-45c8-401d-9bd0-a90f4a727851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.755777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eb10f-45c8-401d-9bd0-a90f4a727851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.756440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eb10f-45c8-401d-9bd0-a90f4a727851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:44.758099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2eb10f-45c8-401d-9bd0-a90f4a727851 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:44.770968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1196/2394] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:44.774992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3ac4-06cf-4d8f-8763-46e275a9d497 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:44.785348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc3ac4-06cf-4d8f-8763-46e275a9d497 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:44.791588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4cfc2-7382-4058-98cb-d600df2bfd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:44.794431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4cfc2-7382-4058-98cb-d600df2bfd7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.794431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4cfc2-7382-4058-98cb-d600df2bfd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.794431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4cfc2-7382-4058-98cb-d600df2bfd7e admin admin] PATH_INFO: `/v3/projects/3daa13ae71944669bedb4ce456abece7/users/732dee64d62a49cb944b484b6ea43ab2/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.810182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4cfc2-7382-4058-98cb-d600df2bfd7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3daa13ae71944669bedb4ce456abece7, user_id=732dee64d62a49cb944b484b6ea43ab2, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:44.814650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4cfc2-7382-4058-98cb-d600df2bfd7e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:44.917355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1199/2395] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:44 2022] PUT /identity/v3/projects/3daa13ae71944669bedb4ce456abece7/users/732dee64d62a49cb944b484b6ea43ab2/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:44.932579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f06e-2f13-4236-832c-43236e1dc523 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:44.932865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f06e-2f13-4236-832c-43236e1dc523 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:44.933188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f06e-2f13-4236-832c-43236e1dc523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:44.966859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-20b8f06e-2f13-4236-832c-43236e1dc523 None None] MFA Rules not processed for user `732dee64d62a49cb944b484b6ea43ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:44.968140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-20b8f06e-2f13-4236-832c-43236e1dc523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:45.038436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1197/2396] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:37:45.043355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4cfc2-7382-4058-98cb-d600df2bfd7e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:45.114922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4cfc2-7382-4058-98cb-d600df2bfd7e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:45.120063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a21a1-0dc2-430a-ad0a-ca388fd37a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:45.120678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a21a1-0dc2-430a-ad0a-ca388fd37a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:45.120993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a21a1-0dc2-430a-ad0a-ca388fd37a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:45.121247 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a21a1-0dc2-430a-ad0a-ca388fd37a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:45.121902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a21a1-0dc2-430a-ad0a-ca388fd37a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:45.123821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a21a1-0dc2-430a-ad0a-ca388fd37a33 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:45.223016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1200/2397] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:45 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:37:45.226465 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8f06e-2f13-4236-832c-43236e1dc523 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:45.238094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8f06e-2f13-4236-832c-43236e1dc523 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:45.299138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d9e9-2b79-41e4-aa9d-9be4c7b53043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:45.299909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d9e9-2b79-41e4-aa9d-9be4c7b53043 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:45.300287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d9e9-2b79-41e4-aa9d-9be4c7b53043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:45.300663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3d9e9-2b79-41e4-aa9d-9be4c7b53043 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:45.301433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d9e9-2b79-41e4-aa9d-9be4c7b53043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:45.303462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3d9e9-2b79-41e4-aa9d-9be4c7b53043 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:45.384981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1198/2398] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:45 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:37:45.386774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a21a1-0dc2-430a-ad0a-ca388fd37a33 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:45.398834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a21a1-0dc2-430a-ad0a-ca388fd37a33 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:45.406177 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fde0-0f52-49de-bb55-4d4665506528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:45.406887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fde0-0f52-49de-bb55-4d4665506528 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:45.407163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fde0-0f52-49de-bb55-4d4665506528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:45.407432 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8fde0-0f52-49de-bb55-4d4665506528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:45.408080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8fde0-0f52-49de-bb55-4d4665506528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:45.409745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8fde0-0f52-49de-bb55-4d4665506528 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:45.424804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1201/2399] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:45.428779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d9e9-2b79-41e4-aa9d-9be4c7b53043 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:45.434986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:45.446044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3d9e9-2b79-41e4-aa9d-9be4c7b53043 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:45.454435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2512-224a-4147-89a5-0dcb1fafadf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:45.455348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2512-224a-4147-89a5-0dcb1fafadf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:45.455627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2512-224a-4147-89a5-0dcb1fafadf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:45.455918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2512-224a-4147-89a5-0dcb1fafadf5 admin admin] PATH_INFO: `/v3/projects/723494b5c9ab4fb4b8e596c786d5e40e/users/25d1631e28bf481aa631f9aa8e25d972/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:45.489764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2512-224a-4147-89a5-0dcb1fafadf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723494b5c9ab4fb4b8e596c786d5e40e, user_id=25d1631e28bf481aa631f9aa8e25d972, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:45.492492 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2512-224a-4147-89a5-0dcb1fafadf5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:45.561226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1199/2400] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:45 2022] PUT /identity/v3/projects/723494b5c9ab4fb4b8e596c786d5e40e/users/25d1631e28bf481aa631f9aa8e25d972/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:45.562523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fde0-0f52-49de-bb55-4d4665506528 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:45.575838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8fde0-0f52-49de-bb55-4d4665506528 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:45.642191 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc04b8b-db0a-445d-9e96-160f36cdcc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:45.642811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc04b8b-db0a-445d-9e96-160f36cdcc5c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:45.643097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc04b8b-db0a-445d-9e96-160f36cdcc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:45.643367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc04b8b-db0a-445d-9e96-160f36cdcc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:45.644606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc04b8b-db0a-445d-9e96-160f36cdcc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:45.645717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc04b8b-db0a-445d-9e96-160f36cdcc5c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:45.657487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1202/2401] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:45.661925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2512-224a-4147-89a5-0dcb1fafadf5 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:45.673380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2512-224a-4147-89a5-0dcb1fafadf5 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:45.679057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:45.679906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:45.680285 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:45.680978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] PATH_INFO: `/v3/projects/723494b5c9ab4fb4b8e596c786d5e40e/users/25d1631e28bf481aa631f9aa8e25d972/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:45.683057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=723494b5c9ab4fb4b8e596c786d5e40e, user_id=25d1631e28bf481aa631f9aa8e25d972, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:45.686151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:45.711161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1200/2402] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:45 2022] PUT /identity/v3/projects/723494b5c9ab4fb4b8e596c786d5e40e/users/25d1631e28bf481aa631f9aa8e25d972/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:45.713035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce8df2-5fac-412c-af8c-b73e4ea4e07a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:45.713488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce8df2-5fac-412c-af8c-b73e4ea4e07a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:45.713631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce8df2-5fac-412c-af8c-b73e4ea4e07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:45.752434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:45.760894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1cce8df2-5fac-412c-af8c-b73e4ea4e07a None None] MFA Rules not processed for user `25d1631e28bf481aa631f9aa8e25d972`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:45.762141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1cce8df2-5fac-412c-af8c-b73e4ea4e07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:45.841777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1203/2403] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:45.853775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:45.855563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:45.946462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85861a04-cce4-4e64-895a-9ac104767e9d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:45.950142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4bdd2-9fc2-4eae-a45f-f23999641827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:45.950756 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4bdd2-9fc2-4eae-a45f-f23999641827 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:45.951038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4bdd2-9fc2-4eae-a45f-f23999641827 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:45.951308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4bdd2-9fc2-4eae-a45f-f23999641827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:45.962326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4bdd2-9fc2-4eae-a45f-f23999641827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:45.963798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4bdd2-9fc2-4eae-a45f-f23999641827 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:45.974538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1201/2404] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:47.007864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce8df2-5fac-412c-af8c-b73e4ea4e07a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:47.078729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce8df2-5fac-412c-af8c-b73e4ea4e07a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:47.084680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:47.085407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:47.085683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:47.085956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] PATH_INFO: `/v3/users/732dee64d62a49cb944b484b6ea43ab2` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:47.087140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] RBAC: Authorizing `identity:delete_user(user_id=732dee64d62a49cb944b484b6ea43ab2)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:47.089394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:47.219319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732dee64d62a49cb944b484b6ea43ab2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:47.220006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732dee64d62a49cb944b484b6ea43ab2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:47.271469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732dee64d62a49cb944b484b6ea43ab2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:47.272320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732dee64d62a49cb944b484b6ea43ab2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:47.289856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732dee64d62a49cb944b484b6ea43ab2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:47.306054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1204/2405] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:37:47 2022] DELETE /identity/v3/users/732dee64d62a49cb944b484b6ea43ab2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:47.310713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508557b-9350-4549-b0d7-fcf2158fd4e8 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:47.311223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508557b-9350-4549-b0d7-fcf2158fd4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:47.311327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508557b-9350-4549-b0d7-fcf2158fd4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:47.332161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a508557b-9350-4549-b0d7-fcf2158fd4e8 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:47.333814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a508557b-9350-4549-b0d7-fcf2158fd4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:47.398294 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1202/2406] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:47.408220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:47.409758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:47.431624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:47.473837 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2c364-91a6-4098-864f-3abc7eac667e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:47.477611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8a84-b63d-44cf-83aa-af4e5870be30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:47.487514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8a84-b63d-44cf-83aa-af4e5870be30 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:47.487514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8a84-b63d-44cf-83aa-af4e5870be30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:47.487514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc8a84-b63d-44cf-83aa-af4e5870be30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:47.490196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc8a84-b63d-44cf-83aa-af4e5870be30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:47.491648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc8a84-b63d-44cf-83aa-af4e5870be30 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:47.502585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1205/2407] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:37:49.058296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508557b-9350-4549-b0d7-fcf2158fd4e8 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:49.070951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a508557b-9350-4549-b0d7-fcf2158fd4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:49.081151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508557b-9350-4549-b0d7-fcf2158fd4e8 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:49.088354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:49.088980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:49.089252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:49.089531 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] PATH_INFO: `/v3/projects/3daa13ae71944669bedb4ce456abece7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:49.090813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3daa13ae71944669bedb4ce456abece7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:49.093291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:49.298618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3daa13ae71944669bedb4ce456abece7', 'request_id': 'req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.308800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3daa13ae71944669bedb4ce456abece7', 'request_id': 'req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.316063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3daa13ae71944669bedb4ce456abece7', 'request_id': 'req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.318581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:49.408573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] The token cache is being invalidate because project 3daa13ae71944669bedb4ce456abece7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:37:49.408899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.409680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.411223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1203/2408] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:37:49 2022] DELETE /identity/v3/projects/3daa13ae71944669bedb4ce456abece7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:37:49.415547 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8a84-b63d-44cf-83aa-af4e5870be30 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:49.428776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc8a84-b63d-44cf-83aa-af4e5870be30 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:49.497663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:49.498295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:49.498574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:49.498875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] PATH_INFO: `/v3/users/25d1631e28bf481aa631f9aa8e25d972` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:49.500011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d1631e28bf481aa631f9aa8e25d972)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:49.501979 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:49.876089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d1631e28bf481aa631f9aa8e25d972'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.877108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d1631e28bf481aa631f9aa8e25d972'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.933588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d1631e28bf481aa631f9aa8e25d972'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.934337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d1631e28bf481aa631f9aa8e25d972'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.949348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-12e62aa1-b018-4380-9dd0-385f03a19784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d1631e28bf481aa631f9aa8e25d972'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:49.963226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1206/2409] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:37:49 2022] DELETE /identity/v3/users/25d1631e28bf481aa631f9aa8e25d972 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:50.441188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:50.442654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:50.457851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1aeff-2e8e-4ff5-aa1d-1511b9c302f0 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:50.545127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:50.545834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:50.546115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:50.546412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] PATH_INFO: `/v3/projects/723494b5c9ab4fb4b8e596c786d5e40e` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:50.547587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723494b5c9ab4fb4b8e596c786d5e40e)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:50.549745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:50.656078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723494b5c9ab4fb4b8e596c786d5e40e', 'request_id': 'req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:50.662226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723494b5c9ab4fb4b8e596c786d5e40e', 'request_id': 'req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:50.667950 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723494b5c9ab4fb4b8e596c786d5e40e', 'request_id': 'req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:50.760644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] The token cache is being invalidate because project 723494b5c9ab4fb4b8e596c786d5e40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:37:50.760937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:50.761631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-7c1a7b09-4d76-4a30-85d7-8953f8b034b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:50.763230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1204/2410] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:37:50 2022] DELETE /identity/v3/projects/723494b5c9ab4fb4b8e596c786d5e40e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:50.770094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0934a1-62bd-4b71-98c8-6724c0b9b561 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:50.770683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0934a1-62bd-4b71-98c8-6724c0b9b561 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:50.770683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0934a1-62bd-4b71-98c8-6724c0b9b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:50.790465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0e0934a1-62bd-4b71-98c8-6724c0b9b561 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:50.791676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0e0934a1-62bd-4b71-98c8-6724c0b9b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:50.825326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:50.853273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1207/2411] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:37:50.866696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97304-cffe-4ba8-990e-fc617062bea3 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:50.871994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97304-cffe-4ba8-990e-fc617062bea3 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:50.871994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d97304-cffe-4ba8-990e-fc617062bea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:50.888009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-13d97304-cffe-4ba8-990e-fc617062bea3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:50.895167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-13d97304-cffe-4ba8-990e-fc617062bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:50.897848 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1205/2412] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:50.902256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0934a1-62bd-4b71-98c8-6724c0b9b561 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:50.913568 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0934a1-62bd-4b71-98c8-6724c0b9b561 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:50.919097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:50.919865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:50.920149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:50.920485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:50.921142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:37:50.922024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:50.923629 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:50.936308 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1208/2413] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:37:50.940637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d97304-cffe-4ba8-990e-fc617062bea3 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:50.949903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d97304-cffe-4ba8-990e-fc617062bea3 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:50.955179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148d33e-ccfd-4892-b7b2-b25a9ca4394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:50.955773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148d33e-ccfd-4892-b7b2-b25a9ca4394f admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:50.956050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148d33e-ccfd-4892-b7b2-b25a9ca4394f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:50.956322 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148d33e-ccfd-4892-b7b2-b25a9ca4394f admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:50.956981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148d33e-ccfd-4892-b7b2-b25a9ca4394f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:50.958874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148d33e-ccfd-4892-b7b2-b25a9ca4394f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:51.089171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1206/2414] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:50 2022] POST /identity/v3/projects => generated 399 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:51.094304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:51.104505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e19003-c193-4953-b7da-e330b84cc8a0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:51.162726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f64b1-6382-4eb3-937c-49f700e89384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:51.163350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f64b1-6382-4eb3-937c-49f700e89384 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:51.163635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f64b1-6382-4eb3-937c-49f700e89384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:51.163913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f64b1-6382-4eb3-937c-49f700e89384 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:51.164599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f64b1-6382-4eb3-937c-49f700e89384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:51.166558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f64b1-6382-4eb3-937c-49f700e89384 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:51.288138 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1209/2415] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:51 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:51.292456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148d33e-ccfd-4892-b7b2-b25a9ca4394f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:51.303158 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148d33e-ccfd-4892-b7b2-b25a9ca4394f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:51.307958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127918d7-3387-460d-b50a-c7c18e23f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:51.308546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127918d7-3387-460d-b50a-c7c18e23f4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:51.308823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127918d7-3387-460d-b50a-c7c18e23f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:51.309127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127918d7-3387-460d-b50a-c7c18e23f4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:51.309768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127918d7-3387-460d-b50a-c7c18e23f4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:51.311344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127918d7-3387-460d-b50a-c7c18e23f4bf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:51.322004 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1207/2416] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:51.326211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f64b1-6382-4eb3-937c-49f700e89384 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:51.340142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f64b1-6382-4eb3-937c-49f700e89384 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:51.346280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402139e-99dc-4688-b0d2-01d37e6fefc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:51.346885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402139e-99dc-4688-b0d2-01d37e6fefc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:51.347165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402139e-99dc-4688-b0d2-01d37e6fefc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:51.347442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402139e-99dc-4688-b0d2-01d37e6fefc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:51.348125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402139e-99dc-4688-b0d2-01d37e6fefc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:51.350750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402139e-99dc-4688-b0d2-01d37e6fefc6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:51.363922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1210/2417] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:51.368375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127918d7-3387-460d-b50a-c7c18e23f4bf admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:51.378471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127918d7-3387-460d-b50a-c7c18e23f4bf admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:51.383184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128da07b-81c5-4480-beda-c98610df9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:51.383829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128da07b-81c5-4480-beda-c98610df9317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:51.384112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128da07b-81c5-4480-beda-c98610df9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:51.384392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128da07b-81c5-4480-beda-c98610df9317 admin admin] PATH_INFO: `/v3/projects/387f8c922e9942708e7d712cac8523e9/users/a1863991edd844c4b1070563bb3981d4/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:51.398753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128da07b-81c5-4480-beda-c98610df9317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387f8c922e9942708e7d712cac8523e9, user_id=a1863991edd844c4b1070563bb3981d4, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:51.401516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128da07b-81c5-4480-beda-c98610df9317 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:51.499533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1208/2418] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:51 2022] PUT /identity/v3/projects/387f8c922e9942708e7d712cac8523e9/users/a1863991edd844c4b1070563bb3981d4/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:51.510972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44865-eac1-4bff-b162-1e8e47e8ca19 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:51.511267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44865-eac1-4bff-b162-1e8e47e8ca19 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:51.511550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd44865-eac1-4bff-b162-1e8e47e8ca19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:51.541104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2bd44865-eac1-4bff-b162-1e8e47e8ca19 None None] MFA Rules not processed for user `a1863991edd844c4b1070563bb3981d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:51.544209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2bd44865-eac1-4bff-b162-1e8e47e8ca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:51.623176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1211/2419] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:51.626435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128da07b-81c5-4480-beda-c98610df9317 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:51.648102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:51.713734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128da07b-81c5-4480-beda-c98610df9317 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:51.719936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9e08b-6359-4738-ac32-3171bc742426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:51.720842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9e08b-6359-4738-ac32-3171bc742426 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:51.726240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9e08b-6359-4738-ac32-3171bc742426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:51.726240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9e08b-6359-4738-ac32-3171bc742426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:51.726240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9e08b-6359-4738-ac32-3171bc742426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:51.726240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9e08b-6359-4738-ac32-3171bc742426 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:51.803964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1209/2420] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:37:51 2022] POST /identity/v3/projects => generated 399 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:37:51.809640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd44865-eac1-4bff-b162-1e8e47e8ca19 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:51.820618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd44865-eac1-4bff-b162-1e8e47e8ca19 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:51.856038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:51.885322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2554a-3ab3-493c-a485-820f796ec5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:51.886068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2554a-3ab3-493c-a485-820f796ec5bc admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:51.886233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2554a-3ab3-493c-a485-820f796ec5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:51.886511 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2554a-3ab3-493c-a485-820f796ec5bc admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:51.887266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2554a-3ab3-493c-a485-820f796ec5bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:51.889214 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2554a-3ab3-493c-a485-820f796ec5bc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:51.952075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1212/2421] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:37:51 2022] POST /identity/v3/users => generated 306 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:37:51.957308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9e08b-6359-4738-ac32-3171bc742426 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:51.970328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9e08b-6359-4738-ac32-3171bc742426 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:51.976727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bad0c-2857-41ab-b8c6-000a8e0479f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:51.977398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bad0c-2857-41ab-b8c6-000a8e0479f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:51.977688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bad0c-2857-41ab-b8c6-000a8e0479f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:51.977971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bad0c-2857-41ab-b8c6-000a8e0479f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:51.978615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bad0c-2857-41ab-b8c6-000a8e0479f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:51.980388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bad0c-2857-41ab-b8c6-000a8e0479f6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:51.993009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1210/2422] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:52.000225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2554a-3ab3-493c-a485-820f796ec5bc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:52.011434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2554a-3ab3-493c-a485-820f796ec5bc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:52.016834 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a31de-0e2b-4028-8a37-4d5469b1b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:52.017695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a31de-0e2b-4028-8a37-4d5469b1b736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:52.017840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a31de-0e2b-4028-8a37-4d5469b1b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:52.018121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a31de-0e2b-4028-8a37-4d5469b1b736 admin admin] PATH_INFO: `/v3/projects/cb7882df892c4a50b2e3c5868406ab7f/users/1eae153d05ab4c0b9f9c45dc0e22ab50/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:52.036253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a31de-0e2b-4028-8a37-4d5469b1b736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb7882df892c4a50b2e3c5868406ab7f, user_id=1eae153d05ab4c0b9f9c45dc0e22ab50, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:52.038987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a31de-0e2b-4028-8a37-4d5469b1b736 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:52.118107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1213/2423] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:51 2022] PUT /identity/v3/projects/cb7882df892c4a50b2e3c5868406ab7f/users/1eae153d05ab4c0b9f9c45dc0e22ab50/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:52.120427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bad0c-2857-41ab-b8c6-000a8e0479f6 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:52.131281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bad0c-2857-41ab-b8c6-000a8e0479f6 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:52.189456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d2da-e2d0-493c-8ac5-f6dbd987f6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:52.190073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d2da-e2d0-493c-8ac5-f6dbd987f6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:52.190953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d2da-e2d0-493c-8ac5-f6dbd987f6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:52.190953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d2da-e2d0-493c-8ac5-f6dbd987f6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:52.191388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d2da-e2d0-493c-8ac5-f6dbd987f6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:52.193020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d2da-e2d0-493c-8ac5-f6dbd987f6a2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:52.204311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1211/2424] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:37:52.208532 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a31de-0e2b-4028-8a37-4d5469b1b736 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:52.218781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a31de-0e2b-4028-8a37-4d5469b1b736 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:52.223770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:52.224509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:52.224881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:52.225184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] PATH_INFO: `/v3/projects/cb7882df892c4a50b2e3c5868406ab7f/users/1eae153d05ab4c0b9f9c45dc0e22ab50/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:52.227142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb7882df892c4a50b2e3c5868406ab7f, user_id=1eae153d05ab4c0b9f9c45dc0e22ab50, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:52.229886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:52.240267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1214/2425] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:37:52 2022] PUT /identity/v3/projects/cb7882df892c4a50b2e3c5868406ab7f/users/1eae153d05ab4c0b9f9c45dc0e22ab50/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:52.251064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddc8a5-b485-4df2-8980-f8f07e694403 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:52.251356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddc8a5-b485-4df2-8980-f8f07e694403 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:52.254208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddc8a5-b485-4df2-8980-f8f07e694403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:52.279893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-70ddc8a5-b485-4df2-8980-f8f07e694403 None None] MFA Rules not processed for user `1eae153d05ab4c0b9f9c45dc0e22ab50`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:52.287860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-70ddc8a5-b485-4df2-8980-f8f07e694403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:52.366837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1212/2426] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:52.379264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:52.381718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:52.450285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb930e-9432-42d2-9112-0563c7f7c1bd admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:52.453919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:52.454518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:52.454803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:52.455073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:52.464050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:52.465509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:52.475295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1215/2427] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:52.704574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddc8a5-b485-4df2-8980-f8f07e694403 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:52.714433 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddc8a5-b485-4df2-8980-f8f07e694403 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:52.718085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f7963-ce5d-4d43-96cf-d64ac2400ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:52.718689 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7963-ce5d-4d43-96cf-d64ac2400ecb service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:52.718971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7963-ce5d-4d43-96cf-d64ac2400ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:52.719248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7963-ce5d-4d43-96cf-d64ac2400ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:52.728781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:52.781646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f7963-ce5d-4d43-96cf-d64ac2400ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:52.783168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f7963-ce5d-4d43-96cf-d64ac2400ecb service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:52.801163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1213/2428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:56.644669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:56.647803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:56.658899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da7765-f5a7-4fa6-910a-6f3a0307b809 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:56.663111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:56.665017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:56.665017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:56.665017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:56.667288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:56.752566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:56.756701 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:56.777619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1216/2429] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:37:57.611674 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb4f0-d0bf-4f60-9443-5abe1c5da7af None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:57.612164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb4f0-d0bf-4f60-9443-5abe1c5da7af None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:57.612343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fb4f0-d0bf-4f60-9443-5abe1c5da7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:57.634354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-608fb4f0-d0bf-4f60-9443-5abe1c5da7af None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:57.640175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-608fb4f0-d0bf-4f60-9443-5abe1c5da7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:57.696333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1214/2430] 10.222.0.39 () {58 vars in 967 bytes} [Mon Sep 5 12:37:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:57.709473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:57.711044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:57.738952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:57.781960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d875d67-30f2-41e7-8d5f-54670c3a36fa service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:57.787038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30238c7-d74c-44db-a98f-ff1732cc7a2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:57.787669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30238c7-d74c-44db-a98f-ff1732cc7a2f service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:57.787959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30238c7-d74c-44db-a98f-ff1732cc7a2f service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:57.788225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30238c7-d74c-44db-a98f-ff1732cc7a2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:57.796625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30238c7-d74c-44db-a98f-ff1732cc7a2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:57.798793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30238c7-d74c-44db-a98f-ff1732cc7a2f service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:57.806931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1217/2431] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 12:37:58.457860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb4f0-d0bf-4f60-9443-5abe1c5da7af None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:58.532025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fb4f0-d0bf-4f60-9443-5abe1c5da7af None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:58.537247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:58.537878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:58.538162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:58.538442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] PATH_INFO: `/v3/users/a1863991edd844c4b1070563bb3981d4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:58.539581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1863991edd844c4b1070563bb3981d4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:58.541582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:58.706931 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1863991edd844c4b1070563bb3981d4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:58.707815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1863991edd844c4b1070563bb3981d4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:58.761963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1863991edd844c4b1070563bb3981d4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:58.767681 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:37:58.775416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1863991edd844c4b1070563bb3981d4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:58.776094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1863991edd844c4b1070563bb3981d4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:58.789079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1215/2432] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:37:58 2022] DELETE /identity/v3/users/a1863991edd844c4b1070563bb3981d4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:58.793929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d55601-ca13-48bf-b463-3017f0c75a49 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:58.797140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d55601-ca13-48bf-b463-3017f0c75a49 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:58.797140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d55601-ca13-48bf-b463-3017f0c75a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:58.816018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-21d55601-ca13-48bf-b463-3017f0c75a49 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:37:58.817265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-21d55601-ca13-48bf-b463-3017f0c75a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:58.896221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1218/2433] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:37:58.905968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:58.907428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:58.967582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3897d11-4671-4fe8-9dba-137801b5ddc7 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:58.971219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6302dfa-aca7-47a2-85b6-2358f95230f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:58.971834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6302dfa-aca7-47a2-85b6-2358f95230f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:58.972112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6302dfa-aca7-47a2-85b6-2358f95230f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:58.972386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6302dfa-aca7-47a2-85b6-2358f95230f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:58.981430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6302dfa-aca7-47a2-85b6-2358f95230f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:58.982864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6302dfa-aca7-47a2-85b6-2358f95230f6 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:58.992579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1216/2434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:37:59.581691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d55601-ca13-48bf-b463-3017f0c75a49 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:59.583348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-21d55601-ca13-48bf-b463-3017f0c75a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:37:59.606046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d55601-ca13-48bf-b463-3017f0c75a49 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:59.612079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:59.612746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:59.613063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:59.613366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] PATH_INFO: `/v3/projects/387f8c922e9942708e7d712cac8523e9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:59.614523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387f8c922e9942708e7d712cac8523e9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:59.616444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:37:59.717965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387f8c922e9942708e7d712cac8523e9', 'request_id': 'req-f60f2ce6-a66d-4ab7-8a85-ac125b195506'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:59.724312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387f8c922e9942708e7d712cac8523e9', 'request_id': 'req-f60f2ce6-a66d-4ab7-8a85-ac125b195506'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:59.729956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387f8c922e9942708e7d712cac8523e9', 'request_id': 'req-f60f2ce6-a66d-4ab7-8a85-ac125b195506'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:59.801829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] The token cache is being invalidate because project 387f8c922e9942708e7d712cac8523e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:37:59.802497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:59.803020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:37:59.804513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1219/2435] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:37:59 2022] DELETE /identity/v3/projects/387f8c922e9942708e7d712cac8523e9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:37:59.808804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6302dfa-aca7-47a2-85b6-2358f95230f6 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:37:59.818956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6302dfa-aca7-47a2-85b6-2358f95230f6 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:37:59.885042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:37:59.885688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:37:59.886009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:37:59.886358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] PATH_INFO: `/v3/users/1eae153d05ab4c0b9f9c45dc0e22ab50` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:37:59.887500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eae153d05ab4c0b9f9c45dc0e22ab50)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:37:59.889490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:00.092514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eae153d05ab4c0b9f9c45dc0e22ab50'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:00.093221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eae153d05ab4c0b9f9c45dc0e22ab50'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:00.150436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eae153d05ab4c0b9f9c45dc0e22ab50'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:00.164729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eae153d05ab4c0b9f9c45dc0e22ab50'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:00.165651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-89e9e525-3ab2-479e-bae1-d574539de68c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eae153d05ab4c0b9f9c45dc0e22ab50'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:00.175763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:00.182418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1217/2436] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:37:59 2022] DELETE /identity/v3/users/1eae153d05ab4c0b9f9c45dc0e22ab50 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:00.741385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:00.743589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:00.764869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2ce6-a66d-4ab7-8a85-ac125b195506 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:00.800620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:00.824612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:00.824612 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:00.825277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:00.825277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] PATH_INFO: `/v3/projects/cb7882df892c4a50b2e3c5868406ab7f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:00.826329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb7882df892c4a50b2e3c5868406ab7f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:00.828231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:00.950616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb7882df892c4a50b2e3c5868406ab7f', 'request_id': 'req-fc47802f-4dd4-4d73-b846-7ab8d550298e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:00.957569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb7882df892c4a50b2e3c5868406ab7f', 'request_id': 'req-fc47802f-4dd4-4d73-b846-7ab8d550298e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:00.963224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb7882df892c4a50b2e3c5868406ab7f', 'request_id': 'req-fc47802f-4dd4-4d73-b846-7ab8d550298e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:01.024556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] The token cache is being invalidate because project cb7882df892c4a50b2e3c5868406ab7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:01.024851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:01.025510 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fc47802f-4dd4-4d73-b846-7ab8d550298e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:01.026997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1220/2437] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:00 2022] DELETE /identity/v3/projects/cb7882df892c4a50b2e3c5868406ab7f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:01.032078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6610-8e58-4179-b5c5-8105b8dc5efb None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.033147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6610-8e58-4179-b5c5-8105b8dc5efb None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.033286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6610-8e58-4179-b5c5-8105b8dc5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.052691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4c3f6610-8e58-4179-b5c5-8105b8dc5efb None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:01.053949 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4c3f6610-8e58-4179-b5c5-8105b8dc5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:01.115418 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1218/2438] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:01.123141 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb5357-3a87-41cc-8022-243b10b86240 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.123437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb5357-3a87-41cc-8022-243b10b86240 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.123719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb5357-3a87-41cc-8022-243b10b86240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.143719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-82bb5357-3a87-41cc-8022-243b10b86240 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:01.144933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-82bb5357-3a87-41cc-8022-243b10b86240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:01.152932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1221/2439] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:01.157191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f6610-8e58-4179-b5c5-8105b8dc5efb None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:01.167600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f6610-8e58-4179-b5c5-8105b8dc5efb None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:01.172383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:01.173741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.174057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.174344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.175029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:01.175340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:01.176985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:01.189261 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1219/2440] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:01.193809 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb5357-3a87-41cc-8022-243b10b86240 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:01.203203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb5357-3a87-41cc-8022-243b10b86240 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:01.207976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b8996-f7ea-43f4-a7d1-ad171a2e3d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:01.208578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8996-f7ea-43f4-a7d1-ad171a2e3d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.208861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8996-f7ea-43f4-a7d1-ad171a2e3d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.209174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8996-f7ea-43f4-a7d1-ad171a2e3d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.209814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b8996-f7ea-43f4-a7d1-ad171a2e3d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:01.211736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b8996-f7ea-43f4-a7d1-ad171a2e3d5d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:01.300915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1222/2441] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:01 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:01.305283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:01.315989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4db37-4719-47bc-a7b2-0656ed844a62 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:01.371458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095940dc-a6a0-45c8-a159-3522c06b003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:01.372067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095940dc-a6a0-45c8-a159-3522c06b003c admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.372353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095940dc-a6a0-45c8-a159-3522c06b003c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.372631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095940dc-a6a0-45c8-a159-3522c06b003c admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.373311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095940dc-a6a0-45c8-a159-3522c06b003c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:01.375227 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095940dc-a6a0-45c8-a159-3522c06b003c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:01.453688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1220/2442] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:01 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:01.457912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b8996-f7ea-43f4-a7d1-ad171a2e3d5d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:01.468542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b8996-f7ea-43f4-a7d1-ad171a2e3d5d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:01.473228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b912c-b3a0-4deb-a383-b44e8ea99fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:01.473830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b912c-b3a0-4deb-a383-b44e8ea99fea admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.474119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b912c-b3a0-4deb-a383-b44e8ea99fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.474406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b912c-b3a0-4deb-a383-b44e8ea99fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.475100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b912c-b3a0-4deb-a383-b44e8ea99fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:01.476698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b912c-b3a0-4deb-a383-b44e8ea99fea admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:01.487468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1223/2443] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:01.491856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095940dc-a6a0-45c8-a159-3522c06b003c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:01.502962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095940dc-a6a0-45c8-a159-3522c06b003c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:01.507962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3f228-2dd2-49ca-b4c1-9cf4f15beaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:01.508576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f228-2dd2-49ca-b4c1-9cf4f15beaef admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.508864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f228-2dd2-49ca-b4c1-9cf4f15beaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.509239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f228-2dd2-49ca-b4c1-9cf4f15beaef admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.509887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3f228-2dd2-49ca-b4c1-9cf4f15beaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:01.511499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3f228-2dd2-49ca-b4c1-9cf4f15beaef admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:01.522673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1221/2444] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:01.527333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b912c-b3a0-4deb-a383-b44e8ea99fea admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:01.537611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b912c-b3a0-4deb-a383-b44e8ea99fea admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:01.542771 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066762-4c0f-4a19-bf2a-055cc11689c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:01.543466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066762-4c0f-4a19-bf2a-055cc11689c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.543856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066762-4c0f-4a19-bf2a-055cc11689c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.544175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5066762-4c0f-4a19-bf2a-055cc11689c5 admin admin] PATH_INFO: `/v3/projects/8c84e0ab179244429ae3e33991547509/users/8bd5297c9b1f4baaa01c981d4a3cf346/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.561125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5066762-4c0f-4a19-bf2a-055cc11689c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c84e0ab179244429ae3e33991547509, user_id=8bd5297c9b1f4baaa01c981d4a3cf346, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:01.565056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5066762-4c0f-4a19-bf2a-055cc11689c5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:01.636084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1224/2445] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:01 2022] PUT /identity/v3/projects/8c84e0ab179244429ae3e33991547509/users/8bd5297c9b1f4baaa01c981d4a3cf346/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:01.648391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7a467-a422-4114-a473-075f591dc975 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.648682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7a467-a422-4114-a473-075f591dc975 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.649518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7a467-a422-4114-a473-075f591dc975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.678717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-02f7a467-a422-4114-a473-075f591dc975 None None] MFA Rules not processed for user `8bd5297c9b1f4baaa01c981d4a3cf346`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:01.680054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-02f7a467-a422-4114-a473-075f591dc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:01.738182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:01.748319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1222/2446] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:01.753140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066762-4c0f-4a19-bf2a-055cc11689c5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:01.816775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5066762-4c0f-4a19-bf2a-055cc11689c5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:01.821687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc2c18-7ae8-4cc6-be0e-e004a7991261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:01.822297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2c18-7ae8-4cc6-be0e-e004a7991261 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.822577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2c18-7ae8-4cc6-be0e-e004a7991261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.822855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc2c18-7ae8-4cc6-be0e-e004a7991261 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.823536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc2c18-7ae8-4cc6-be0e-e004a7991261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:01.825527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc2c18-7ae8-4cc6-be0e-e004a7991261 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:01.833776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:01.900328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1225/2447] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:01 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:01.904635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7a467-a422-4114-a473-075f591dc975 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:01.916054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7a467-a422-4114-a473-075f591dc975 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:01.976112 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6581d0-375e-4fe0-bd4c-682fff3f352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:01.976722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6581d0-375e-4fe0-bd4c-682fff3f352d admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:01.977035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6581d0-375e-4fe0-bd4c-682fff3f352d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:01.977309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6581d0-375e-4fe0-bd4c-682fff3f352d admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:01.977954 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6581d0-375e-4fe0-bd4c-682fff3f352d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:01.979880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6581d0-375e-4fe0-bd4c-682fff3f352d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:02.117005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1223/2448] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:01 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:02.128729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc2c18-7ae8-4cc6-be0e-e004a7991261 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:02.139844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc2c18-7ae8-4cc6-be0e-e004a7991261 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:02.145145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351088a-5a22-47ca-a675-184b0b6ec786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:02.145755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351088a-5a22-47ca-a675-184b0b6ec786 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:02.146035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351088a-5a22-47ca-a675-184b0b6ec786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:02.146306 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351088a-5a22-47ca-a675-184b0b6ec786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:02.146961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351088a-5a22-47ca-a675-184b0b6ec786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:02.148631 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351088a-5a22-47ca-a675-184b0b6ec786 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:02.163565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1226/2449] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:02.167541 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6581d0-375e-4fe0-bd4c-682fff3f352d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:02.177765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6581d0-375e-4fe0-bd4c-682fff3f352d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:02.182736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277345-dcbd-401d-a352-60f3e27ffdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:02.183397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277345-dcbd-401d-a352-60f3e27ffdc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:02.183679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277345-dcbd-401d-a352-60f3e27ffdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:02.183959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c277345-dcbd-401d-a352-60f3e27ffdc7 admin admin] PATH_INFO: `/v3/projects/ff883875230c4afcbca28194df3eaac2/users/e24df6636c7a47f1892f337ee71c9079/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:02.200489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c277345-dcbd-401d-a352-60f3e27ffdc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff883875230c4afcbca28194df3eaac2, user_id=e24df6636c7a47f1892f337ee71c9079, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:02.203250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c277345-dcbd-401d-a352-60f3e27ffdc7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:02.281983 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1224/2450] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:02 2022] PUT /identity/v3/projects/ff883875230c4afcbca28194df3eaac2/users/e24df6636c7a47f1892f337ee71c9079/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:02.286565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351088a-5a22-47ca-a675-184b0b6ec786 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:02.296706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351088a-5a22-47ca-a675-184b0b6ec786 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:02.352050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd107ed5-bdec-463a-b990-a4a299b2672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:02.352647 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd107ed5-bdec-463a-b990-a4a299b2672c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:02.352926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd107ed5-bdec-463a-b990-a4a299b2672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:02.353222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd107ed5-bdec-463a-b990-a4a299b2672c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:02.353857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd107ed5-bdec-463a-b990-a4a299b2672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:02.355431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd107ed5-bdec-463a-b990-a4a299b2672c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:02.364898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1227/2451] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:38:02.369250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277345-dcbd-401d-a352-60f3e27ffdc7 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:02.381240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c277345-dcbd-401d-a352-60f3e27ffdc7 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:02.387882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:02.388569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:02.388850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:02.389163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] PATH_INFO: `/v3/projects/ff883875230c4afcbca28194df3eaac2/users/e24df6636c7a47f1892f337ee71c9079/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:02.391257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff883875230c4afcbca28194df3eaac2, user_id=e24df6636c7a47f1892f337ee71c9079, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:02.394721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:02.406739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1225/2452] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:02 2022] PUT /identity/v3/projects/ff883875230c4afcbca28194df3eaac2/users/e24df6636c7a47f1892f337ee71c9079/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:02.417654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e43d-b17d-45ad-912a-b26c74618484 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:02.417977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e43d-b17d-45ad-912a-b26c74618484 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:02.418215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e43d-b17d-45ad-912a-b26c74618484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:02.446724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7de5e43d-b17d-45ad-912a-b26c74618484 None None] MFA Rules not processed for user `e24df6636c7a47f1892f337ee71c9079`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:02.447994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7de5e43d-b17d-45ad-912a-b26c74618484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:02.532323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1228/2453] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:02.543940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:02.545647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:02.604120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b24f05-b8f1-4b1c-9fff-52130db5dd8d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:02.608244 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdf0c5-2c5b-4152-8385-8e3ea99cebc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:02.608753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf0c5-2c5b-4152-8385-8e3ea99cebc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:02.609068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf0c5-2c5b-4152-8385-8e3ea99cebc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:02.609348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf0c5-2c5b-4152-8385-8e3ea99cebc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:02.630671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdf0c5-2c5b-4152-8385-8e3ea99cebc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:02.632160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdf0c5-2c5b-4152-8385-8e3ea99cebc3 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:02.644338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1226/2454] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:02.756225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e43d-b17d-45ad-912a-b26c74618484 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:02.766182 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e43d-b17d-45ad-912a-b26c74618484 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:02.772107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c399876-f28d-4415-9a81-b87b97ffa8a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:02.772769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c399876-f28d-4415-9a81-b87b97ffa8a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:02.773121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c399876-f28d-4415-9a81-b87b97ffa8a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:02.773404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c399876-f28d-4415-9a81-b87b97ffa8a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:02.863226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:02.866340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c399876-f28d-4415-9a81-b87b97ffa8a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:02.867949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c399876-f28d-4415-9a81-b87b97ffa8a0 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:02.879963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1229/2455] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:06.174356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdf0c5-2c5b-4152-8385-8e3ea99cebc3 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:06.234672 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:06.244916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdf0c5-2c5b-4152-8385-8e3ea99cebc3 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:06.250123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:06.251831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:06.252125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:06.252677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] PATH_INFO: `/v3/users/8bd5297c9b1f4baaa01c981d4a3cf346` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:06.253984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd5297c9b1f4baaa01c981d4a3cf346)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:06.256005 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:06.515168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd5297c9b1f4baaa01c981d4a3cf346'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:06.515168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd5297c9b1f4baaa01c981d4a3cf346'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:06.608440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd5297c9b1f4baaa01c981d4a3cf346'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:06.632897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd5297c9b1f4baaa01c981d4a3cf346'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:06.633691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd5297c9b1f4baaa01c981d4a3cf346'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:06.647298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1227/2456] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:06 2022] DELETE /identity/v3/users/8bd5297c9b1f4baaa01c981d4a3cf346 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:06.651983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d61a5-d92c-4557-bd62-87abefffe50b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:06.652456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d61a5-d92c-4557-bd62-87abefffe50b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:06.652554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d61a5-d92c-4557-bd62-87abefffe50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:06.677522 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-444d61a5-d92c-4557-bd62-87abefffe50b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:06.678789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-444d61a5-d92c-4557-bd62-87abefffe50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:06.756258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1230/2457] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:06.764474 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:06.766505 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:06.838395 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384a2a1-40e8-4cf3-b402-85993ce44edd admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:06.842679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efb629-3107-4423-8d6a-360601c6a083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:06.843407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efb629-3107-4423-8d6a-360601c6a083 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:06.845612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efb629-3107-4423-8d6a-360601c6a083 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:06.845612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efb629-3107-4423-8d6a-360601c6a083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:06.854824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efb629-3107-4423-8d6a-360601c6a083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:06.856276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efb629-3107-4423-8d6a-360601c6a083 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:06.870300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1228/2458] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:07.353015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d61a5-d92c-4557-bd62-87abefffe50b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:07.354519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-444d61a5-d92c-4557-bd62-87abefffe50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:07.367378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d61a5-d92c-4557-bd62-87abefffe50b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:07.372073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:07.372720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:07.373029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:07.373310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] PATH_INFO: `/v3/projects/8c84e0ab179244429ae3e33991547509` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:07.377179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c84e0ab179244429ae3e33991547509)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:07.377179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:07.518197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c84e0ab179244429ae3e33991547509', 'request_id': 'req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:07.524416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c84e0ab179244429ae3e33991547509', 'request_id': 'req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:07.530255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c84e0ab179244429ae3e33991547509', 'request_id': 'req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:07.617900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] The token cache is being invalidate because project 8c84e0ab179244429ae3e33991547509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:07.618185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:07.618929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:07.620478 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1231/2459] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:07 2022] DELETE /identity/v3/projects/8c84e0ab179244429ae3e33991547509 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:07.624455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efb629-3107-4423-8d6a-360601c6a083 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:07.634266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efb629-3107-4423-8d6a-360601c6a083 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:07.691128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:07.691759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:07.692042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:07.692319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] PATH_INFO: `/v3/users/e24df6636c7a47f1892f337ee71c9079` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:07.693480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24df6636c7a47f1892f337ee71c9079)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:07.695414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:07.708219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:07.924715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24df6636c7a47f1892f337ee71c9079'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:07.926331 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24df6636c7a47f1892f337ee71c9079'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.029975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24df6636c7a47f1892f337ee71c9079'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.043016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24df6636c7a47f1892f337ee71c9079'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.043992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e736ce24-1575-4fb2-9b76-7fd49c2b4871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24df6636c7a47f1892f337ee71c9079'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.057663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1229/2460] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:07 2022] DELETE /identity/v3/users/e24df6636c7a47f1892f337ee71c9079 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:08.519090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:08.520585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:08.534495 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b975c88-cd32-4d20-9e9f-c33f0a4be3ee admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:08.603954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:08.604792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:08.605295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:08.605737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] PATH_INFO: `/v3/projects/ff883875230c4afcbca28194df3eaac2` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:08.607055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff883875230c4afcbca28194df3eaac2)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:08.609498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:08.636688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:08.724428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff883875230c4afcbca28194df3eaac2', 'request_id': 'req-3446d293-f423-49bb-ba45-05e8467d7f17'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.731789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff883875230c4afcbca28194df3eaac2', 'request_id': 'req-3446d293-f423-49bb-ba45-05e8467d7f17'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.739712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff883875230c4afcbca28194df3eaac2', 'request_id': 'req-3446d293-f423-49bb-ba45-05e8467d7f17'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.823872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] The token cache is being invalidate because project ff883875230c4afcbca28194df3eaac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:08.824088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.824783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3446d293-f423-49bb-ba45-05e8467d7f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:08.826310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1232/2461] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:08 2022] DELETE /identity/v3/projects/ff883875230c4afcbca28194df3eaac2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:08.831544 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694415-7304-4613-a3be-9d1caf434c08 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:08.832061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694415-7304-4613-a3be-9d1caf434c08 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:08.832214 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a694415-7304-4613-a3be-9d1caf434c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:08.853994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7a694415-7304-4613-a3be-9d1caf434c08 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:08.856898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7a694415-7304-4613-a3be-9d1caf434c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:08.921801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1230/2462] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:38:08.930978 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d7f0-6582-4837-9bbf-7b7610483ef1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:08.931366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d7f0-6582-4837-9bbf-7b7610483ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:08.931665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d7f0-6582-4837-9bbf-7b7610483ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:08.954461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5765d7f0-6582-4837-9bbf-7b7610483ef1 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:08.955653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5765d7f0-6582-4837-9bbf-7b7610483ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:08.964192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1233/2463] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:38:08.968737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a694415-7304-4613-a3be-9d1caf434c08 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:08.979945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a694415-7304-4613-a3be-9d1caf434c08 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:08.984794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:08.986064 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:08.986365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:08.986635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:08.987281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:08.987582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:08.989295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:09.001934 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1231/2464] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:09.011664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765d7f0-6582-4837-9bbf-7b7610483ef1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:09.021709 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765d7f0-6582-4837-9bbf-7b7610483ef1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:09.026456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034631c-3b92-40d9-ad34-1e0b6f3ca2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:09.027051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034631c-3b92-40d9-ad34-1e0b6f3ca2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:09.027412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034631c-3b92-40d9-ad34-1e0b6f3ca2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:09.027609 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034631c-3b92-40d9-ad34-1e0b6f3ca2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:09.028249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034631c-3b92-40d9-ad34-1e0b6f3ca2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:09.030385 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034631c-3b92-40d9-ad34-1e0b6f3ca2c0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:09.106780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1234/2465] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:09 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:09.111823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:09.122266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bf78c-87a6-4fa8-b3f3-4754a5780633 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:09.178116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572463f-5ccb-4476-9f7f-6f2baf8935f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:09.178721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572463f-5ccb-4476-9f7f-6f2baf8935f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:09.179006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572463f-5ccb-4476-9f7f-6f2baf8935f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:09.179282 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572463f-5ccb-4476-9f7f-6f2baf8935f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:09.179912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572463f-5ccb-4476-9f7f-6f2baf8935f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:09.182153 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572463f-5ccb-4476-9f7f-6f2baf8935f7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:09.259932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1232/2466] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:09 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:09.262518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034631c-3b92-40d9-ad34-1e0b6f3ca2c0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:09.274973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034631c-3b92-40d9-ad34-1e0b6f3ca2c0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:09.286107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0184-963e-48d1-85bf-22cdf5569179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:09.286107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0184-963e-48d1-85bf-22cdf5569179 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:09.286107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0184-963e-48d1-85bf-22cdf5569179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:09.286107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a0184-963e-48d1-85bf-22cdf5569179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:09.286656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a0184-963e-48d1-85bf-22cdf5569179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:09.286656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a0184-963e-48d1-85bf-22cdf5569179 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:09.424153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1235/2467] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:09.428076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572463f-5ccb-4476-9f7f-6f2baf8935f7 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:09.439903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572463f-5ccb-4476-9f7f-6f2baf8935f7 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:09.445478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f8554-7844-4a3d-a359-e2804b0fd91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:09.446097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8554-7844-4a3d-a359-e2804b0fd91a admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:09.446381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8554-7844-4a3d-a359-e2804b0fd91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:09.446656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8554-7844-4a3d-a359-e2804b0fd91a admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:09.447314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f8554-7844-4a3d-a359-e2804b0fd91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:09.448935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f8554-7844-4a3d-a359-e2804b0fd91a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:09.450446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:09.462387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1233/2468] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:09.465236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0184-963e-48d1-85bf-22cdf5569179 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:09.476089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a0184-963e-48d1-85bf-22cdf5569179 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:09.486371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da2d6-156a-4ae8-8b51-a7f9055c64d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:09.487076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da2d6-156a-4ae8-8b51-a7f9055c64d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:09.487359 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da2d6-156a-4ae8-8b51-a7f9055c64d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:09.490107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200da2d6-156a-4ae8-8b51-a7f9055c64d8 admin admin] PATH_INFO: `/v3/projects/bfc607f490714e0ba725ccbc01630111/users/39f07de857c04bf3b80b76968d5670ee/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:09.502807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200da2d6-156a-4ae8-8b51-a7f9055c64d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc607f490714e0ba725ccbc01630111, user_id=39f07de857c04bf3b80b76968d5670ee, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:09.505573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200da2d6-156a-4ae8-8b51-a7f9055c64d8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:09.659183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1236/2469] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:09 2022] PUT /identity/v3/projects/bfc607f490714e0ba725ccbc01630111/users/39f07de857c04bf3b80b76968d5670ee/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:09.670045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6ee6-16e2-4459-8304-5714051e0bea None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:09.670612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6ee6-16e2-4459-8304-5714051e0bea None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:09.671096 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb6ee6-16e2-4459-8304-5714051e0bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:09.713169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-40cb6ee6-16e2-4459-8304-5714051e0bea None None] MFA Rules not processed for user `39f07de857c04bf3b80b76968d5670ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:09.714394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-40cb6ee6-16e2-4459-8304-5714051e0bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:09.783016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1234/2470] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:09.787507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da2d6-156a-4ae8-8b51-a7f9055c64d8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:09.851732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200da2d6-156a-4ae8-8b51-a7f9055c64d8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:09.856504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeb82f-5a38-415d-bec2-7fa8e3c4e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:09.857139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb82f-5a38-415d-bec2-7fa8e3c4e87f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:09.857420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb82f-5a38-415d-bec2-7fa8e3c4e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:09.857692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaeb82f-5a38-415d-bec2-7fa8e3c4e87f admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:09.858333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaeb82f-5a38-415d-bec2-7fa8e3c4e87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:09.860729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaeb82f-5a38-415d-bec2-7fa8e3c4e87f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:10.021491 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1237/2471] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:09 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:10.025713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb6ee6-16e2-4459-8304-5714051e0bea None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:10.036887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb6ee6-16e2-4459-8304-5714051e0bea None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:10.092717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bec60-502c-4252-82fe-c0b174720cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:10.093358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bec60-502c-4252-82fe-c0b174720cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.093644 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bec60-502c-4252-82fe-c0b174720cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.093921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bec60-502c-4252-82fe-c0b174720cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.094555 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bec60-502c-4252-82fe-c0b174720cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:10.097074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bec60-502c-4252-82fe-c0b174720cf6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:10.191193 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1235/2472] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:10 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:10.195016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeb82f-5a38-415d-bec2-7fa8e3c4e87f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:10.206205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaeb82f-5a38-415d-bec2-7fa8e3c4e87f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:10.211148 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0d64-f4b1-4058-af8f-a96d6a668ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:10.211759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0d64-f4b1-4058-af8f-a96d6a668ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.212043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0d64-f4b1-4058-af8f-a96d6a668ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.212315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0d64-f4b1-4058-af8f-a96d6a668ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.212991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0d64-f4b1-4058-af8f-a96d6a668ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:10.214611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0d64-f4b1-4058-af8f-a96d6a668ee2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:10.230403 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1238/2473] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:38:10.230517 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bec60-502c-4252-82fe-c0b174720cf6 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:10.240362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bec60-502c-4252-82fe-c0b174720cf6 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:10.245444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8de29-b449-43ca-b3b0-a4bedcf4ca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:10.246124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8de29-b449-43ca-b3b0-a4bedcf4ca41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.246393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8de29-b449-43ca-b3b0-a4bedcf4ca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.248931 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8de29-b449-43ca-b3b0-a4bedcf4ca41 admin admin] PATH_INFO: `/v3/projects/b16da03157784a93b3a2e5b63e0dab2a/users/0f7d65ee9a0243fe919e5e092f7a26f5/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.263484 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8de29-b449-43ca-b3b0-a4bedcf4ca41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16da03157784a93b3a2e5b63e0dab2a, user_id=0f7d65ee9a0243fe919e5e092f7a26f5, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:10.266246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8de29-b449-43ca-b3b0-a4bedcf4ca41 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:10.361673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1236/2474] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:10 2022] PUT /identity/v3/projects/b16da03157784a93b3a2e5b63e0dab2a/users/0f7d65ee9a0243fe919e5e092f7a26f5/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:10.365934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0d64-f4b1-4058-af8f-a96d6a668ee2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:10.375596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0d64-f4b1-4058-af8f-a96d6a668ee2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:10.393664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:10.434165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f7fff-dc37-4737-b6e6-b9f714c055d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:10.434772 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7fff-dc37-4737-b6e6-b9f714c055d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.435053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7fff-dc37-4737-b6e6-b9f714c055d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.435328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f7fff-dc37-4737-b6e6-b9f714c055d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.435976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f7fff-dc37-4737-b6e6-b9f714c055d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:10.437607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f7fff-dc37-4737-b6e6-b9f714c055d6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:10.448642 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1239/2475] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:10.458612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8de29-b449-43ca-b3b0-a4bedcf4ca41 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:10.469738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8de29-b449-43ca-b3b0-a4bedcf4ca41 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:10.476733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:10.477456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.477741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.478020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] PATH_INFO: `/v3/projects/b16da03157784a93b3a2e5b63e0dab2a/users/0f7d65ee9a0243fe919e5e092f7a26f5/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.480160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16da03157784a93b3a2e5b63e0dab2a, user_id=0f7d65ee9a0243fe919e5e092f7a26f5, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:10.482980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:10.495467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1237/2476] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:10 2022] PUT /identity/v3/projects/b16da03157784a93b3a2e5b63e0dab2a/users/0f7d65ee9a0243fe919e5e092f7a26f5/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:10.507929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7f3a-8ad5-4372-9460-8b4b5b453d92 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.508204 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7f3a-8ad5-4372-9460-8b4b5b453d92 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.508471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d7f3a-8ad5-4372-9460-8b4b5b453d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.541618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b45d7f3a-8ad5-4372-9460-8b4b5b453d92 None None] MFA Rules not processed for user `0f7d65ee9a0243fe919e5e092f7a26f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:10.542805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b45d7f3a-8ad5-4372-9460-8b4b5b453d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:10.630484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1240/2477] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:10.643008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:10.645264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:10.693263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:10.711193 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16f88c-2b1d-4d74-bf70-c70d3fa618ff admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:10.715403 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4e756-fcb3-467a-984f-000e674a1e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:10.716105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e756-fcb3-467a-984f-000e674a1e95 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.716407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e756-fcb3-467a-984f-000e674a1e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.716678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4e756-fcb3-467a-984f-000e674a1e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.729830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4e756-fcb3-467a-984f-000e674a1e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:10.731645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4e756-fcb3-467a-984f-000e674a1e95 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:10.741410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1238/2478] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:10.785789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7f3a-8ad5-4372-9460-8b4b5b453d92 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:10.787555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b45d7f3a-8ad5-4372-9460-8b4b5b453d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:10.867004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d7f3a-8ad5-4372-9460-8b4b5b453d92 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:10.876439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec9c3-6abd-4340-8af8-06919b882494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:10.877105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec9c3-6abd-4340-8af8-06919b882494 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.877463 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec9c3-6abd-4340-8af8-06919b882494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.878266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec9c3-6abd-4340-8af8-06919b882494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.880397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0c7ec9c3-6abd-4340-8af8-06919b882494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:10.899799 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4e756-fcb3-467a-984f-000e674a1e95 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:10.951176 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:10.964073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec9c3-6abd-4340-8af8-06919b882494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:10.967511 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec9c3-6abd-4340-8af8-06919b882494 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:10.968776 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4e756-fcb3-467a-984f-000e674a1e95 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:10.974102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:10.974733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:10.975009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:10.975276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] PATH_INFO: `/v3/users/39f07de857c04bf3b80b76968d5670ee` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:10.976423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f07de857c04bf3b80b76968d5670ee)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:10.976543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1241/2479] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:10.978442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:11.130637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f07de857c04bf3b80b76968d5670ee'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:11.132137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f07de857c04bf3b80b76968d5670ee'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:11.178690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f07de857c04bf3b80b76968d5670ee'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:11.197607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f07de857c04bf3b80b76968d5670ee'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:11.198361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f07de857c04bf3b80b76968d5670ee'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:11.219611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1239/2480] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:10 2022] DELETE /identity/v3/users/39f07de857c04bf3b80b76968d5670ee => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:11.221523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78b5d5-f3d2-4111-8e29-6edf1fd34ca7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:11.221931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78b5d5-f3d2-4111-8e29-6edf1fd34ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:11.222310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78b5d5-f3d2-4111-8e29-6edf1fd34ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:11.247014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2e78b5d5-f3d2-4111-8e29-6edf1fd34ca7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:11.248645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2e78b5d5-f3d2-4111-8e29-6edf1fd34ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:11.319336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1242/2481] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:11.326241 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:11.327705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:11.393985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3ff58-b27e-4b43-a208-753e29eeb016 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:11.398100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e7afe-8354-4a4d-aea5-d1b024ee31a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:11.398722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e7afe-8354-4a4d-aea5-d1b024ee31a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:11.399008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e7afe-8354-4a4d-aea5-d1b024ee31a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:11.399279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e7afe-8354-4a4d-aea5-d1b024ee31a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:11.409260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e7afe-8354-4a4d-aea5-d1b024ee31a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:11.410861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e7afe-8354-4a4d-aea5-d1b024ee31a4 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:11.427397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1240/2482] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:11.839210 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78b5d5-f3d2-4111-8e29-6edf1fd34ca7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:11.841502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2e78b5d5-f3d2-4111-8e29-6edf1fd34ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:11.860513 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78b5d5-f3d2-4111-8e29-6edf1fd34ca7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:11.874083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:11.874972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:11.875618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:11.875917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] PATH_INFO: `/v3/projects/bfc607f490714e0ba725ccbc01630111` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:11.877278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc607f490714e0ba725ccbc01630111)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:11.879334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:11.994173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc607f490714e0ba725ccbc01630111', 'request_id': 'req-1680fde8-b017-4258-adb7-4a357a319f50'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.001006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc607f490714e0ba725ccbc01630111', 'request_id': 'req-1680fde8-b017-4258-adb7-4a357a319f50'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.011484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc607f490714e0ba725ccbc01630111', 'request_id': 'req-1680fde8-b017-4258-adb7-4a357a319f50'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.104656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] The token cache is being invalidate because project bfc607f490714e0ba725ccbc01630111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:12.105113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.110441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.110441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1243/2483] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:11 2022] DELETE /identity/v3/projects/bfc607f490714e0ba725ccbc01630111 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:12.112313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e7afe-8354-4a4d-aea5-d1b024ee31a4 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:12.117440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:12.126002 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e7afe-8354-4a4d-aea5-d1b024ee31a4 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:12.194294 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:12.195164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:12.195311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:12.195475 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] PATH_INFO: `/v3/users/0f7d65ee9a0243fe919e5e092f7a26f5` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:12.196638 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7d65ee9a0243fe919e5e092f7a26f5)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:12.198609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:12.396203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7d65ee9a0243fe919e5e092f7a26f5'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.397187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7d65ee9a0243fe919e5e092f7a26f5'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.492932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7d65ee9a0243fe919e5e092f7a26f5'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.507506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7d65ee9a0243fe919e5e092f7a26f5'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.508259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d1843767-8862-4779-a192-f4516c7eeaaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7d65ee9a0243fe919e5e092f7a26f5'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:12.521527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1241/2484] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:12 2022] DELETE /identity/v3/users/0f7d65ee9a0243fe919e5e092f7a26f5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:13.125579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:13.127183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:13.142431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680fde8-b017-4258-adb7-4a357a319f50 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:13.223009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:13.223655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:13.223936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:13.224209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] PATH_INFO: `/v3/projects/b16da03157784a93b3a2e5b63e0dab2a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:13.225417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16da03157784a93b3a2e5b63e0dab2a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:13.227346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:13.255657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:13.399731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16da03157784a93b3a2e5b63e0dab2a', 'request_id': 'req-a53df649-7740-4812-8294-0b7a271c2a12'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:13.408490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16da03157784a93b3a2e5b63e0dab2a', 'request_id': 'req-a53df649-7740-4812-8294-0b7a271c2a12'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:13.416070 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16da03157784a93b3a2e5b63e0dab2a', 'request_id': 'req-a53df649-7740-4812-8294-0b7a271c2a12'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:13.515769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] The token cache is being invalidate because project b16da03157784a93b3a2e5b63e0dab2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:13.516231 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:13.516823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a53df649-7740-4812-8294-0b7a271c2a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:13.519366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1244/2485] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:13 2022] DELETE /identity/v3/projects/b16da03157784a93b3a2e5b63e0dab2a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:13.524547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a0c3-b500-4cb9-939d-9a675d235387 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:13.525051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a0c3-b500-4cb9-939d-9a675d235387 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:13.525390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435a0c3-b500-4cb9-939d-9a675d235387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:13.546023 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1435a0c3-b500-4cb9-939d-9a675d235387 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:13.547306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1435a0c3-b500-4cb9-939d-9a675d235387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:13.632632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1242/2486] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:13.634335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5651e2-2bfc-41a5-b7e4-e7239b2a9833 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:13.634624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5651e2-2bfc-41a5-b7e4-e7239b2a9833 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:13.634918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5651e2-2bfc-41a5-b7e4-e7239b2a9833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:13.665081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ff5651e2-2bfc-41a5-b7e4-e7239b2a9833 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:13.666526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ff5651e2-2bfc-41a5-b7e4-e7239b2a9833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:13.675294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1245/2487] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:13.679624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a0c3-b500-4cb9-939d-9a675d235387 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:13.689642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435a0c3-b500-4cb9-939d-9a675d235387 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:13.694880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:13.695696 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:13.696084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:13.696393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:13.697085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:13.697398 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:13.699273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:13.712317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1243/2488] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:13.716686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5651e2-2bfc-41a5-b7e4-e7239b2a9833 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:13.728125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5651e2-2bfc-41a5-b7e4-e7239b2a9833 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:13.732879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506350c-e936-45b5-ba36-1093d253cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:13.733548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506350c-e936-45b5-ba36-1093d253cfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:13.733830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506350c-e936-45b5-ba36-1093d253cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:13.734102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506350c-e936-45b5-ba36-1093d253cfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:13.734757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506350c-e936-45b5-ba36-1093d253cfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:13.736744 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506350c-e936-45b5-ba36-1093d253cfe0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:13.818904 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1246/2489] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:13 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:13.823579 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:13.835814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfa9c1-6cf9-49e8-8946-3f353121918a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:13.848051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:13.907820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350597c-38fc-4eff-a1e2-d6065b61d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:13.908822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350597c-38fc-4eff-a1e2-d6065b61d77f admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:13.909179 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350597c-38fc-4eff-a1e2-d6065b61d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:13.909582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350597c-38fc-4eff-a1e2-d6065b61d77f admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:13.910589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350597c-38fc-4eff-a1e2-d6065b61d77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:13.913752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350597c-38fc-4eff-a1e2-d6065b61d77f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:14.065131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1244/2490] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:13 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:14.070108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506350c-e936-45b5-ba36-1093d253cfe0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:14.081056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506350c-e936-45b5-ba36-1093d253cfe0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:14.088760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38788bca-c481-4e7f-9871-f0d1c37a7395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:14.089412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38788bca-c481-4e7f-9871-f0d1c37a7395 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:14.089698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38788bca-c481-4e7f-9871-f0d1c37a7395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:14.090168 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38788bca-c481-4e7f-9871-f0d1c37a7395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:14.090628 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38788bca-c481-4e7f-9871-f0d1c37a7395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:14.092384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38788bca-c481-4e7f-9871-f0d1c37a7395 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:14.106384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1247/2491] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:14.112247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350597c-38fc-4eff-a1e2-d6065b61d77f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:14.123859 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350597c-38fc-4eff-a1e2-d6065b61d77f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:14.130711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de8e64-5635-4b28-a80a-43eece8332e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:14.131338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8e64-5635-4b28-a80a-43eece8332e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:14.131633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8e64-5635-4b28-a80a-43eece8332e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:14.131938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8e64-5635-4b28-a80a-43eece8332e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:14.132611 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de8e64-5635-4b28-a80a-43eece8332e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:14.134366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de8e64-5635-4b28-a80a-43eece8332e1 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:14.148991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1245/2492] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:14.151757 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38788bca-c481-4e7f-9871-f0d1c37a7395 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:14.162791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38788bca-c481-4e7f-9871-f0d1c37a7395 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:14.167742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:14.169515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:14.169515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:14.169515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] PATH_INFO: `/v3/projects/f888501998af49138ea486be6a128ae8/users/82609689b9b545f6a4bc50f6023b4ba4/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:14.184374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f888501998af49138ea486be6a128ae8, user_id=82609689b9b545f6a4bc50f6023b4ba4, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:14.187068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:14.322952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1248/2493] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:14 2022] PUT /identity/v3/projects/f888501998af49138ea486be6a128ae8/users/82609689b9b545f6a4bc50f6023b4ba4/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:14.334223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3a144-66c8-4b69-9a77-f439c1562772 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:14.334506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3a144-66c8-4b69-9a77-f439c1562772 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:14.334811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3a144-66c8-4b69-9a77-f439c1562772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:14.380496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-3ef3a144-66c8-4b69-9a77-f439c1562772 None None] MFA Rules not processed for user `82609689b9b545f6a4bc50f6023b4ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:14.382464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3ef3a144-66c8-4b69-9a77-f439c1562772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:14.506379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1246/2494] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:14.529416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:14.531282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:14.635729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4834a5a-c8b0-4e85-92e6-0c57653a322e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:14.641379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d04271-4fc4-4f79-9481-dc71f147e9cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:14.642970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d04271-4fc4-4f79-9481-dc71f147e9cf service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:14.643257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d04271-4fc4-4f79-9481-dc71f147e9cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:14.643534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d04271-4fc4-4f79-9481-dc71f147e9cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:14.653845 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d04271-4fc4-4f79-9481-dc71f147e9cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:14.655535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d04271-4fc4-4f79-9481-dc71f147e9cf service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:14.672032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1249/2495] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:14.698233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3a144-66c8-4b69-9a77-f439c1562772 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:14.800656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3a144-66c8-4b69-9a77-f439c1562772 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:14.806383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:14.807045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:14.807324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:14.807600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] PATH_INFO: `/v3/users/82609689b9b545f6a4bc50f6023b4ba4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:14.808762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82609689b9b545f6a4bc50f6023b4ba4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:14.810743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:14.836033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:15.063622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82609689b9b545f6a4bc50f6023b4ba4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.064391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82609689b9b545f6a4bc50f6023b4ba4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.172795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82609689b9b545f6a4bc50f6023b4ba4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.189521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82609689b9b545f6a4bc50f6023b4ba4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.190479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82609689b9b545f6a4bc50f6023b4ba4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.207916 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1247/2496] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:14 2022] DELETE /identity/v3/users/82609689b9b545f6a4bc50f6023b4ba4 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:15.212619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f989-0642-44ef-9940-6ecd1f59d921 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:15.213136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f989-0642-44ef-9940-6ecd1f59d921 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:15.213331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4f989-0642-44ef-9940-6ecd1f59d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:15.233674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2cc4f989-0642-44ef-9940-6ecd1f59d921 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:15.234938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2cc4f989-0642-44ef-9940-6ecd1f59d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:15.277046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:15.295654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1250/2497] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:15.306309 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:15.307743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:15.327866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4f989-0642-44ef-9940-6ecd1f59d921 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:15.329427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2cc4f989-0642-44ef-9940-6ecd1f59d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:15.341791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4f989-0642-44ef-9940-6ecd1f59d921 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:15.347505 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:15.348152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:15.348685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:15.348685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] PATH_INFO: `/v3/users/4ac91d9adcf244a6bc7de4a98c565de8` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:15.349921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac91d9adcf244a6bc7de4a98c565de8)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:15.351864 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:15.370314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6b33-31d4-4e58-8ec7-4ee5ca14a807 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:15.373607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:15.374234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:15.374504 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:15.374779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:15.384766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:15.386240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:15.395868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1248/2498] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:15.529603 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac91d9adcf244a6bc7de4a98c565de8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.530276 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac91d9adcf244a6bc7de4a98c565de8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.585367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac91d9adcf244a6bc7de4a98c565de8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.586174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac91d9adcf244a6bc7de4a98c565de8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.601425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac91d9adcf244a6bc7de4a98c565de8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:15.615084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1251/2499] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:15 2022] DELETE /identity/v3/users/4ac91d9adcf244a6bc7de4a98c565de8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:15.854825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:15.856300 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:15.870007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0cbd-0aee-45d4-a391-28e0ffb8dbb3 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:15.912017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:15.913741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:15.934787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:15.935529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:15.935907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:15.936190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] PATH_INFO: `/v3/projects/f888501998af49138ea486be6a128ae8` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:15.939175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f888501998af49138ea486be6a128ae8)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:15.940263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.000840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c7cec-a1a2-4ccf-a8ec-08b28bae968b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.006503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.007197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.007482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.007760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] PATH_INFO: `/v3/projects/495ba1ac5b8843f59f3ab689a1bdae53` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.008893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=495ba1ac5b8843f59f3ab689a1bdae53)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.010840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.078662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:16.085655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f888501998af49138ea486be6a128ae8', 'request_id': 'req-912fbb41-288e-4a3b-97bb-0b59e74c3830'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.092455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f888501998af49138ea486be6a128ae8', 'request_id': 'req-912fbb41-288e-4a3b-97bb-0b59e74c3830'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.098027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f888501998af49138ea486be6a128ae8', 'request_id': 'req-912fbb41-288e-4a3b-97bb-0b59e74c3830'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.146466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495ba1ac5b8843f59f3ab689a1bdae53', 'request_id': 'req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.153124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495ba1ac5b8843f59f3ab689a1bdae53', 'request_id': 'req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.157102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:16.159917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495ba1ac5b8843f59f3ab689a1bdae53', 'request_id': 'req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.211865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] The token cache is being invalidate because project f888501998af49138ea486be6a128ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:16.212160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.212788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-912fbb41-288e-4a3b-97bb-0b59e74c3830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.214317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1249/2500] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:15 2022] DELETE /identity/v3/projects/f888501998af49138ea486be6a128ae8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:16.218873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c1d7-b73d-47f1-9645-deec3bf70482 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.219161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c1d7-b73d-47f1-9645-deec3bf70482 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.219441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518c1d7-b73d-47f1-9645-deec3bf70482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.241446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-5518c1d7-b73d-47f1-9645-deec3bf70482 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:16.242665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5518c1d7-b73d-47f1-9645-deec3bf70482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:16.298653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] The token cache is being invalidate because project 495ba1ac5b8843f59f3ab689a1bdae53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:16.302766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.302766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ba0cdab4-2961-4a4c-b2db-65cdfaaa5b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:16.302766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1252/2501] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:15 2022] DELETE /identity/v3/projects/495ba1ac5b8843f59f3ab689a1bdae53 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:16.303037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1250/2502] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:38:16.306506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82bcfe-d4ba-4609-ba1d-e2385c41cd98 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.306796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82bcfe-d4ba-4609-ba1d-e2385c41cd98 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.307222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82bcfe-d4ba-4609-ba1d-e2385c41cd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.309654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e6ce8-1dc5-4dbc-930e-8aea302ca6f1 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.310061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e6ce8-1dc5-4dbc-930e-8aea302ca6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.310467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e6ce8-1dc5-4dbc-930e-8aea302ca6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.326671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6c82bcfe-d4ba-4609-ba1d-e2385c41cd98 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:16.327900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6c82bcfe-d4ba-4609-ba1d-e2385c41cd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:16.331787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8f6e6ce8-1dc5-4dbc-930e-8aea302ca6f1 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:16.332973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8f6e6ce8-1dc5-4dbc-930e-8aea302ca6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:16.337268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1253/2503] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:16.340901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1251/2504] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:38:16.344885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9811beb-df4c-4d4d-a8de-33fefde83553 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.345061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e6ce8-1dc5-4dbc-930e-8aea302ca6f1 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.345195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9811beb-df4c-4d4d-a8de-33fefde83553 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.345467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9811beb-df4c-4d4d-a8de-33fefde83553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.355172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e6ce8-1dc5-4dbc-930e-8aea302ca6f1 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.360589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.361221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.361498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.361763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.364350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:16.364663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.366875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.370827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a9811beb-df4c-4d4d-a8de-33fefde83553 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:16.372672 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a9811beb-df4c-4d4d-a8de-33fefde83553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:16.384986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1254/2505] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:38:16.385206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1252/2506] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:38:16.388435 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9811beb-df4c-4d4d-a8de-33fefde83553 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.388577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.398903 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9811beb-df4c-4d4d-a8de-33fefde83553 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.399085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02b096-9082-49f6-b453-c9a7ebdad755 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.403759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.403936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb465a-0a56-478b-9ccb-68416b97e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.404361 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.404474 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb465a-0a56-478b-9ccb-68416b97e843 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.404644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.404784 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb465a-0a56-478b-9ccb-68416b97e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.404933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.405073 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb465a-0a56-478b-9ccb-68416b97e843 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.405676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:16.405982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.406262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb465a-0a56-478b-9ccb-68416b97e843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.407611 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.408188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb465a-0a56-478b-9ccb-68416b97e843 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.420218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1255/2507] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:16.424671 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.435130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8df748-4f1f-4542-bd02-842cb135ad7a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.439970 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722c48-a0ae-401d-b3fb-20611a771091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.440581 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722c48-a0ae-401d-b3fb-20611a771091 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.440854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722c48-a0ae-401d-b3fb-20611a771091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.441154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722c48-a0ae-401d-b3fb-20611a771091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.441781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc722c48-a0ae-401d-b3fb-20611a771091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.443652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc722c48-a0ae-401d-b3fb-20611a771091 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.494865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1253/2508] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:16.499364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb465a-0a56-478b-9ccb-68416b97e843 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.561506 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb465a-0a56-478b-9ccb-68416b97e843 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.566855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf8dde-55a6-4d22-b132-2427c1ff571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.567460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf8dde-55a6-4d22-b132-2427c1ff571c admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.567738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf8dde-55a6-4d22-b132-2427c1ff571c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.568008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf8dde-55a6-4d22-b132-2427c1ff571c admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.568635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf8dde-55a6-4d22-b132-2427c1ff571c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.570594 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf8dde-55a6-4d22-b132-2427c1ff571c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.580158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1256/2509] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/projects => generated 403 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:16.584795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722c48-a0ae-401d-b3fb-20611a771091 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.656535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722c48-a0ae-401d-b3fb-20611a771091 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.661427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb8826-17ca-4dc3-a330-a16d7ef5a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.662035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb8826-17ca-4dc3-a330-a16d7ef5a5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.662321 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb8826-17ca-4dc3-a330-a16d7ef5a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.662621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb8826-17ca-4dc3-a330-a16d7ef5a5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.663260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb8826-17ca-4dc3-a330-a16d7ef5a5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.665456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb8826-17ca-4dc3-a330-a16d7ef5a5b8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.681257 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1254/2510] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:16.682536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf8dde-55a6-4d22-b132-2427c1ff571c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.699951 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf8dde-55a6-4d22-b132-2427c1ff571c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.704732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f9d4b-0b8b-4cc4-9408-1a4a82fc279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.708329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f9d4b-0b8b-4cc4-9408-1a4a82fc279e admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.708329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f9d4b-0b8b-4cc4-9408-1a4a82fc279e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.708329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f9d4b-0b8b-4cc4-9408-1a4a82fc279e admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.708329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f9d4b-0b8b-4cc4-9408-1a4a82fc279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.708699 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f9d4b-0b8b-4cc4-9408-1a4a82fc279e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.719020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1255/2511] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:16.723500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f9d4b-0b8b-4cc4-9408-1a4a82fc279e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.734042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f9d4b-0b8b-4cc4-9408-1a4a82fc279e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.739069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d0ee-79c3-4ec8-976c-40549fa1b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.739679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d0ee-79c3-4ec8-976c-40549fa1b4fd admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.739961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d0ee-79c3-4ec8-976c-40549fa1b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.740260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d0ee-79c3-4ec8-976c-40549fa1b4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.740902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d0ee-79c3-4ec8-976c-40549fa1b4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.742567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d0ee-79c3-4ec8-976c-40549fa1b4fd admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.743997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:16.756736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1256/2512] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:38:16.761832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d0ee-79c3-4ec8-976c-40549fa1b4fd admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.764280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1257/2513] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/users => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:16.769346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb8826-17ca-4dc3-a330-a16d7ef5a5b8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.774702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d0ee-79c3-4ec8-976c-40549fa1b4fd admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.779621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb6a21-9bf5-474a-a55f-8e5e7309c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.784456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6a21-9bf5-474a-a55f-8e5e7309c86c admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.784456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6a21-9bf5-474a-a55f-8e5e7309c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.784456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb6a21-9bf5-474a-a55f-8e5e7309c86c admin admin] PATH_INFO: `/v3/projects/54d7ef7065b042b68429a6801c14b865/users/eb88b51e35f44e94b56de903b8e203c7/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.784823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb8826-17ca-4dc3-a330-a16d7ef5a5b8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.786660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46815b4-d00a-4929-9a36-709316465b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.787258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46815b4-d00a-4929-9a36-709316465b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.787540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46815b4-d00a-4929-9a36-709316465b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.787813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46815b4-d00a-4929-9a36-709316465b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.788497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46815b4-d00a-4929-9a36-709316465b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.790129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46815b4-d00a-4929-9a36-709316465b5c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.795967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb6a21-9bf5-474a-a55f-8e5e7309c86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d7ef7065b042b68429a6801c14b865, user_id=eb88b51e35f44e94b56de903b8e203c7, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.798903 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb6a21-9bf5-474a-a55f-8e5e7309c86c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.800339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1258/2514] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:16.804307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46815b4-d00a-4929-9a36-709316465b5c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.814531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46815b4-d00a-4929-9a36-709316465b5c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.819981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c571a0-4c54-4543-83da-9530de311ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.820561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c571a0-4c54-4543-83da-9530de311ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.820841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c571a0-4c54-4543-83da-9530de311ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.821174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c571a0-4c54-4543-83da-9530de311ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.821833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c571a0-4c54-4543-83da-9530de311ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.823431 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c571a0-4c54-4543-83da-9530de311ebc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.838530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1259/2515] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:38:16.838835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c571a0-4c54-4543-83da-9530de311ebc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.849392 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c571a0-4c54-4543-83da-9530de311ebc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:16.854328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b8452-2e02-4e61-a44b-7f04c727fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:16.854973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8452-2e02-4e61-a44b-7f04c727fe81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.855246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8452-2e02-4e61-a44b-7f04c727fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.855619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8452-2e02-4e61-a44b-7f04c727fe81 admin admin] PATH_INFO: `/v3/projects/d2fce676c99c4efeba3389e14a745047/users/56d0efc859f94f55908087d47534d4b2/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.865565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1257/2516] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:16 2022] PUT /identity/v3/projects/54d7ef7065b042b68429a6801c14b865/users/eb88b51e35f44e94b56de903b8e203c7/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:16.872850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b8452-2e02-4e61-a44b-7f04c727fe81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fce676c99c4efeba3389e14a745047, user_id=56d0efc859f94f55908087d47534d4b2, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:16.875526 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b8452-2e02-4e61-a44b-7f04c727fe81 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:16.877035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f138-75f6-43cc-9ecb-32c765a2fb53 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.877328 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f138-75f6-43cc-9ecb-32c765a2fb53 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.877605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241f138-75f6-43cc-9ecb-32c765a2fb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.907855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a241f138-75f6-43cc-9ecb-32c765a2fb53 None None] MFA Rules not processed for user `eb88b51e35f44e94b56de903b8e203c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:16.909192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a241f138-75f6-43cc-9ecb-32c765a2fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:16.967224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1260/2517] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:16 2022] PUT /identity/v3/projects/d2fce676c99c4efeba3389e14a745047/users/56d0efc859f94f55908087d47534d4b2/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:16.977007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1258/2518] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:38:16.978575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f08da-f6a4-4f5b-8fd9-ef579ac46586 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:16.978871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f08da-f6a4-4f5b-8fd9-ef579ac46586 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:16.979147 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f08da-f6a4-4f5b-8fd9-ef579ac46586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:16.989422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f138-75f6-43cc-9ecb-32c765a2fb53 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:16.990938 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a241f138-75f6-43cc-9ecb-32c765a2fb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:17.008751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-509f08da-f6a4-4f5b-8fd9-ef579ac46586 None None] MFA Rules not processed for user `56d0efc859f94f55908087d47534d4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:17.010104 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-509f08da-f6a4-4f5b-8fd9-ef579ac46586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:17.044374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:17.050561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241f138-75f6-43cc-9ecb-32c765a2fb53 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:17.082439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1261/2519] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:17.086954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f08da-f6a4-4f5b-8fd9-ef579ac46586 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:17.105809 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4541396-f806-495c-9334-072e5b3f28ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a29dd8d28f44f0b311d167fd39b4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:17.106428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541396-f806-495c-9334-072e5b3f28ec service glance] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.106713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541396-f806-495c-9334-072e5b3f28ec service glance] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.107008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541396-f806-495c-9334-072e5b3f28ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:17.136976 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:17.149467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f08da-f6a4-4f5b-8fd9-ef579ac46586 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:17.154414 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4239a7-e008-4868-8e6c-437054bc9511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:17.155053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4239a7-e008-4868-8e6c-437054bc9511 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.155331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4239a7-e008-4868-8e6c-437054bc9511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.155616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4239a7-e008-4868-8e6c-437054bc9511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:17.156285 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4239a7-e008-4868-8e6c-437054bc9511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:17.158219 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4239a7-e008-4868-8e6c-437054bc9511 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:17.164822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4541396-f806-495c-9334-072e5b3f28ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:17.170233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4541396-f806-495c-9334-072e5b3f28ec service glance] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:17.175352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1259/2520] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:17.257444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1262/2521] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:17 2022] POST /identity/v3/projects => generated 403 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:17.259652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4541396-f806-495c-9334-072e5b3f28ec service glance] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:17.271098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4541396-f806-495c-9334-072e5b3f28ec service glance] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:17.332159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32ba59-2392-495e-8d52-7b80539d0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:17.332159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ba59-2392-495e-8d52-7b80539d0ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.332159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ba59-2392-495e-8d52-7b80539d0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.332159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32ba59-2392-495e-8d52-7b80539d0ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:17.332717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32ba59-2392-495e-8d52-7b80539d0ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:17.333576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32ba59-2392-495e-8d52-7b80539d0ce9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:17.408305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1260/2522] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:17 2022] POST /identity/v3/users => generated 308 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:17.412795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4239a7-e008-4868-8e6c-437054bc9511 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:17.423644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4239a7-e008-4868-8e6c-437054bc9511 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:17.429640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7841b26-5e36-4b4d-a93a-ba808f3ed213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:17.429640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7841b26-5e36-4b4d-a93a-ba808f3ed213 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.430050 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7841b26-5e36-4b4d-a93a-ba808f3ed213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.430667 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7841b26-5e36-4b4d-a93a-ba808f3ed213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:17.431390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7841b26-5e36-4b4d-a93a-ba808f3ed213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:17.433087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7841b26-5e36-4b4d-a93a-ba808f3ed213 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:17.447444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1263/2523] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:17.448621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32ba59-2392-495e-8d52-7b80539d0ce9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:17.464171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32ba59-2392-495e-8d52-7b80539d0ce9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:17.464171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c92a-4804-4a67-aba3-6388d223eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:17.464449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c92a-4804-4a67-aba3-6388d223eaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.464573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c92a-4804-4a67-aba3-6388d223eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.464855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c92a-4804-4a67-aba3-6388d223eaa1 admin admin] PATH_INFO: `/v3/projects/2f55cfc153ad47719669caa3dfa0fd86/users/d9ad491fa9424de78835d0f68d6fac27/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:17.480288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c92a-4804-4a67-aba3-6388d223eaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f55cfc153ad47719669caa3dfa0fd86, user_id=d9ad491fa9424de78835d0f68d6fac27, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:17.482995 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c92a-4804-4a67-aba3-6388d223eaa1 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:17.544802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1261/2524] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:17 2022] PUT /identity/v3/projects/2f55cfc153ad47719669caa3dfa0fd86/users/d9ad491fa9424de78835d0f68d6fac27/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:17.548737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7841b26-5e36-4b4d-a93a-ba808f3ed213 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:17.559966 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7841b26-5e36-4b4d-a93a-ba808f3ed213 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:17.616166 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed247ae3-21b1-4f3a-9d15-8a5a6d3048ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:17.616784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed247ae3-21b1-4f3a-9d15-8a5a6d3048ac admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.617089 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed247ae3-21b1-4f3a-9d15-8a5a6d3048ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.617366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed247ae3-21b1-4f3a-9d15-8a5a6d3048ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:17.618013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed247ae3-21b1-4f3a-9d15-8a5a6d3048ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:17.619608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed247ae3-21b1-4f3a-9d15-8a5a6d3048ac admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:17.629583 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1264/2525] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:17.633820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c92a-4804-4a67-aba3-6388d223eaa1 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:17.644240 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c92a-4804-4a67-aba3-6388d223eaa1 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:17.649015 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:17.649618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.649909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.650187 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] PATH_INFO: `/v3/projects/2f55cfc153ad47719669caa3dfa0fd86/users/d9ad491fa9424de78835d0f68d6fac27/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:17.652145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f55cfc153ad47719669caa3dfa0fd86, user_id=d9ad491fa9424de78835d0f68d6fac27, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:17.654856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:17.666059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1262/2526] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:17 2022] PUT /identity/v3/projects/2f55cfc153ad47719669caa3dfa0fd86/users/d9ad491fa9424de78835d0f68d6fac27/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:17.678550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837ffb-4a8e-4751-b418-f540eaa43436 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.678841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837ffb-4a8e-4751-b418-f540eaa43436 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.679121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837ffb-4a8e-4751-b418-f540eaa43436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:17.710105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f8837ffb-4a8e-4751-b418-f540eaa43436 None None] MFA Rules not processed for user `d9ad491fa9424de78835d0f68d6fac27`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:17.711324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f8837ffb-4a8e-4751-b418-f540eaa43436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:17.741201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:17.789493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1265/2527] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:17.922090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:17.923854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:17.990829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2233f3-8829-498d-b456-d991fcf87234 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:17.994441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a925b-9f1c-44a8-8f40-16d840d67b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:17.995077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a925b-9f1c-44a8-8f40-16d840d67b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:17.995332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a925b-9f1c-44a8-8f40-16d840d67b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:17.995609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a925b-9f1c-44a8-8f40-16d840d67b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:18.005335 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a925b-9f1c-44a8-8f40-16d840d67b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:18.006778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a925b-9f1c-44a8-8f40-16d840d67b5a service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:18.021629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1263/2528] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:17 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:18.246394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8837ffb-4a8e-4751-b418-f540eaa43436 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:18.318328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8837ffb-4a8e-4751-b418-f540eaa43436 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:18.323425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:18.324067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:18.324357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:18.324636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] PATH_INFO: `/v3/users/56d0efc859f94f55908087d47534d4b2` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:18.325868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d0efc859f94f55908087d47534d4b2)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:18.327824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:18.631049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d0efc859f94f55908087d47534d4b2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:18.631726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d0efc859f94f55908087d47534d4b2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:18.728193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d0efc859f94f55908087d47534d4b2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:18.729355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d0efc859f94f55908087d47534d4b2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:18.749213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d0efc859f94f55908087d47534d4b2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:18.767633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1266/2529] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:18 2022] DELETE /identity/v3/users/56d0efc859f94f55908087d47534d4b2 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:18.773959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b20c4-f281-4525-a4b1-d4dbb76ea63b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:18.774481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b20c4-f281-4525-a4b1-d4dbb76ea63b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:18.774939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b20c4-f281-4525-a4b1-d4dbb76ea63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:18.813627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-da2b20c4-f281-4525-a4b1-d4dbb76ea63b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:18.815020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-da2b20c4-f281-4525-a4b1-d4dbb76ea63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:18.843072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:18.888905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1264/2530] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:18.899854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:18.901344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:18.960225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:18.965658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c91f7-302b-4238-ad95-a2ea7a8040ff admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:18.970136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b32e-603f-4a07-a062-dfe88c53e274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:18.970726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b32e-603f-4a07-a062-dfe88c53e274 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:18.971013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b32e-603f-4a07-a062-dfe88c53e274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:18.971355 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8b32e-603f-4a07-a062-dfe88c53e274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:18.981795 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8b32e-603f-4a07-a062-dfe88c53e274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:18.983139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8b32e-603f-4a07-a062-dfe88c53e274 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:18.992591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1267/2531] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:19.409857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b20c4-f281-4525-a4b1-d4dbb76ea63b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:19.411387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-da2b20c4-f281-4525-a4b1-d4dbb76ea63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:19.426036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b20c4-f281-4525-a4b1-d4dbb76ea63b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:19.432301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:19.433172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:19.433455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:19.433745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] PATH_INFO: `/v3/projects/d2fce676c99c4efeba3389e14a745047` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:19.435033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fce676c99c4efeba3389e14a745047)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:19.437291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:19.570945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fce676c99c4efeba3389e14a745047', 'request_id': 'req-3cdfe563-67e0-40fd-86ca-58b8504e64cb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:19.578082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fce676c99c4efeba3389e14a745047', 'request_id': 'req-3cdfe563-67e0-40fd-86ca-58b8504e64cb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:19.583821 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fce676c99c4efeba3389e14a745047', 'request_id': 'req-3cdfe563-67e0-40fd-86ca-58b8504e64cb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:19.693058 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] The token cache is being invalidate because project d2fce676c99c4efeba3389e14a745047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:19.693354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:19.694019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:19.695516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1265/2532] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:19 2022] DELETE /identity/v3/projects/d2fce676c99c4efeba3389e14a745047 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:19.699881 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b32e-603f-4a07-a062-dfe88c53e274 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:19.709725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8b32e-603f-4a07-a062-dfe88c53e274 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:19.766262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:19.767179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:19.767465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:19.767737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] PATH_INFO: `/v3/users/d9ad491fa9424de78835d0f68d6fac27` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:19.768865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ad491fa9424de78835d0f68d6fac27)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:19.770821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:19.980232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ad491fa9424de78835d0f68d6fac27'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:19.980894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ad491fa9424de78835d0f68d6fac27'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:20.052343 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ad491fa9424de78835d0f68d6fac27'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:20.052989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ad491fa9424de78835d0f68d6fac27'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:20.066502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ed21264a-afaa-4dc6-a305-a9823374c7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ad491fa9424de78835d0f68d6fac27'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:20.082589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1268/2533] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:19 2022] DELETE /identity/v3/users/d9ad491fa9424de78835d0f68d6fac27 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:20.649352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:20.650959 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:20.665275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfe563-67e0-40fd-86ca-58b8504e64cb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:20.756346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:20.757008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:20.757288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:20.757561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] PATH_INFO: `/v3/projects/2f55cfc153ad47719669caa3dfa0fd86` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:20.758705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f55cfc153ad47719669caa3dfa0fd86)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:20.760660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:20.887960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f55cfc153ad47719669caa3dfa0fd86', 'request_id': 'req-a000f3e1-5ee1-4e9d-8d47-21b481523c39'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:20.890044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:20.899310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f55cfc153ad47719669caa3dfa0fd86', 'request_id': 'req-a000f3e1-5ee1-4e9d-8d47-21b481523c39'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:20.907785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f55cfc153ad47719669caa3dfa0fd86', 'request_id': 'req-a000f3e1-5ee1-4e9d-8d47-21b481523c39'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:21.047207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] The token cache is being invalidate because project 2f55cfc153ad47719669caa3dfa0fd86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:21.047497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:21.048207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-a000f3e1-5ee1-4e9d-8d47-21b481523c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:21.049729 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1266/2534] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:20 2022] DELETE /identity/v3/projects/2f55cfc153ad47719669caa3dfa0fd86 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:21.054660 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50cc3-db94-4bb0-8e9c-76b90c422504 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.055469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50cc3-db94-4bb0-8e9c-76b90c422504 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.055469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b50cc3-db94-4bb0-8e9c-76b90c422504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.076987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-42b50cc3-db94-4bb0-8e9c-76b90c422504 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:21.082485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-42b50cc3-db94-4bb0-8e9c-76b90c422504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:21.142150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1269/2535] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:21.150752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e832e-cad9-47e8-847a-b2f99cc152cc None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.151242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e832e-cad9-47e8-847a-b2f99cc152cc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.152466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e832e-cad9-47e8-847a-b2f99cc152cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.174386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a95e832e-cad9-47e8-847a-b2f99cc152cc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:21.175586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a95e832e-cad9-47e8-847a-b2f99cc152cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:21.184369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1267/2536] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:21.188635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b50cc3-db94-4bb0-8e9c-76b90c422504 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:21.198430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b50cc3-db94-4bb0-8e9c-76b90c422504 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:21.203127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:21.203717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.203991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.204258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.204900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:21.205237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:21.207400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:21.209788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:21.218939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1270/2537] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:21.223970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e832e-cad9-47e8-847a-b2f99cc152cc None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:21.233739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e832e-cad9-47e8-847a-b2f99cc152cc None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:21.240311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e9bea-f17f-4fae-94f0-bb6630c919b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:21.240311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9bea-f17f-4fae-94f0-bb6630c919b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.240311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9bea-f17f-4fae-94f0-bb6630c919b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.240733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9bea-f17f-4fae-94f0-bb6630c919b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.241042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e9bea-f17f-4fae-94f0-bb6630c919b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:21.244845 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e9bea-f17f-4fae-94f0-bb6630c919b3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:21.328155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1268/2538] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:21 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:21.333016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:21.343347 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022ed8-cfd9-48b8-91de-447fefdec6d0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:21.400149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba349-e85e-4fd6-a805-01e2ff784fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:21.400672 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba349-e85e-4fd6-a805-01e2ff784fad admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.400975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba349-e85e-4fd6-a805-01e2ff784fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.401256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba349-e85e-4fd6-a805-01e2ff784fad admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.401899 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccba349-e85e-4fd6-a805-01e2ff784fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:21.403886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccba349-e85e-4fd6-a805-01e2ff784fad admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:21.527396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1271/2539] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:21 2022] POST /identity/v3/users => generated 279 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:21.531718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e9bea-f17f-4fae-94f0-bb6630c919b3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:21.541918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e9bea-f17f-4fae-94f0-bb6630c919b3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:21.546605 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff6324-8da4-4197-bb35-fc56e7d77648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:21.547209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff6324-8da4-4197-bb35-fc56e7d77648 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.547489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff6324-8da4-4197-bb35-fc56e7d77648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.547764 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff6324-8da4-4197-bb35-fc56e7d77648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.548430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff6324-8da4-4197-bb35-fc56e7d77648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:21.550056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff6324-8da4-4197-bb35-fc56e7d77648 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:21.560436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1269/2540] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:38:21.564796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba349-e85e-4fd6-a805-01e2ff784fad admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:21.576323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba349-e85e-4fd6-a805-01e2ff784fad admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:21.581553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d486b-7d38-411e-af4b-84a3c69959b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:21.582850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d486b-7d38-411e-af4b-84a3c69959b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.583146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d486b-7d38-411e-af4b-84a3c69959b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.583476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d486b-7d38-411e-af4b-84a3c69959b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.584183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d486b-7d38-411e-af4b-84a3c69959b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:21.585923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d486b-7d38-411e-af4b-84a3c69959b8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:21.598857 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1272/2541] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:21.605720 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff6324-8da4-4197-bb35-fc56e7d77648 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:21.614174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff6324-8da4-4197-bb35-fc56e7d77648 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:21.618883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fb855-4150-4742-834e-d2a9db68a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:21.619552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fb855-4150-4742-834e-d2a9db68a1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.619815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fb855-4150-4742-834e-d2a9db68a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.620120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fb855-4150-4742-834e-d2a9db68a1cf admin admin] PATH_INFO: `/v3/projects/ea64010fec804fd2afffc4fcb59acd0e/users/ab4e36a634434e1abe0c2864adf6c5f1/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.634726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fb855-4150-4742-834e-d2a9db68a1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea64010fec804fd2afffc4fcb59acd0e, user_id=ab4e36a634434e1abe0c2864adf6c5f1, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:21.637389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fb855-4150-4742-834e-d2a9db68a1cf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:21.716136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1270/2542] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:21 2022] PUT /identity/v3/projects/ea64010fec804fd2afffc4fcb59acd0e/users/ab4e36a634434e1abe0c2864adf6c5f1/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:21.728367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e5367-728f-459b-9799-477caace2fe9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.728669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e5367-728f-459b-9799-477caace2fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.728993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e5367-728f-459b-9799-477caace2fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.758634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-694e5367-728f-459b-9799-477caace2fe9 None None] MFA Rules not processed for user `ab4e36a634434e1abe0c2864adf6c5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:21.760266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-694e5367-728f-459b-9799-477caace2fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:21.839615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1273/2543] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:21.844037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fb855-4150-4742-834e-d2a9db68a1cf admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:21.909086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fb855-4150-4742-834e-d2a9db68a1cf admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:21.914523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:21.915134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:21.915421 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:21.915714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:21.916355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:21.918337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:22.053381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1271/2544] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:21 2022] POST /identity/v3/projects => generated 357 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:22.054705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e5367-728f-459b-9799-477caace2fe9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:22.067049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e5367-728f-459b-9799-477caace2fe9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:22.129152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5f178-a1c9-4b52-8c3c-d2a2920f3163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:22.129796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5f178-a1c9-4b52-8c3c-d2a2920f3163 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:22.130073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5f178-a1c9-4b52-8c3c-d2a2920f3163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:22.130344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5f178-a1c9-4b52-8c3c-d2a2920f3163 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:22.130980 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5f178-a1c9-4b52-8c3c-d2a2920f3163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:22.132895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5f178-a1c9-4b52-8c3c-d2a2920f3163 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:22.143850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:22.245666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:22.251310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:22.263021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1274/2545] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:22 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:22.269152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5f178-a1c9-4b52-8c3c-d2a2920f3163 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:22.285187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5f178-a1c9-4b52-8c3c-d2a2920f3163 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:22.291738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f712-6fc2-4f05-b32b-5e79a4e0d1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:22.292494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f712-6fc2-4f05-b32b-5e79a4e0d1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:22.292861 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f712-6fc2-4f05-b32b-5e79a4e0d1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:22.293229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f712-6fc2-4f05-b32b-5e79a4e0d1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:22.293897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795f712-6fc2-4f05-b32b-5e79a4e0d1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:22.295517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795f712-6fc2-4f05-b32b-5e79a4e0d1eb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:22.308619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1275/2546] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:22.313085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f712-6fc2-4f05-b32b-5e79a4e0d1eb admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:22.324053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f712-6fc2-4f05-b32b-5e79a4e0d1eb admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:22.329624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044326e4-edb4-4555-ae8d-e334177be058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:22.329990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044326e4-edb4-4555-ae8d-e334177be058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:22.330831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044326e4-edb4-4555-ae8d-e334177be058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:22.330831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044326e4-edb4-4555-ae8d-e334177be058 admin admin] PATH_INFO: `/v3/projects/f190c6d330234d8a8e463cedb2f41c8a/users/1356807fb3a14ede8cd8fc9eeeaab085/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:22.347651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044326e4-edb4-4555-ae8d-e334177be058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f190c6d330234d8a8e463cedb2f41c8a, user_id=1356807fb3a14ede8cd8fc9eeeaab085, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:22.350481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044326e4-edb4-4555-ae8d-e334177be058 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:22.365852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:22.370670 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caba4d4-40a8-464f-b53a-266597b732f9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:22.376301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:22.376924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:22.377239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:22.377514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:22.379907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:22.393532 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:22.396163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:22.407652 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1272/2547] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:38:22.477947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1276/2548] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:22 2022] PUT /identity/v3/projects/f190c6d330234d8a8e463cedb2f41c8a/users/1356807fb3a14ede8cd8fc9eeeaab085/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:22.482125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:22.495371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bdb6b-0011-477a-8455-1d40b6a57973 service placement] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:22.577343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bd5e2-1008-435a-a046-7212fd77715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:22.577343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bd5e2-1008-435a-a046-7212fd77715d admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:22.577343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bd5e2-1008-435a-a046-7212fd77715d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:22.577343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bd5e2-1008-435a-a046-7212fd77715d admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:22.577936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bd5e2-1008-435a-a046-7212fd77715d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:22.577936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bd5e2-1008-435a-a046-7212fd77715d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:22.588495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1273/2549] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:22.592566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044326e4-edb4-4555-ae8d-e334177be058 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:22.605011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044326e4-edb4-4555-ae8d-e334177be058 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:22.609604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:22.610277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:22.610563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:22.610840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] PATH_INFO: `/v3/projects/f190c6d330234d8a8e463cedb2f41c8a/users/1356807fb3a14ede8cd8fc9eeeaab085/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:22.612810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f190c6d330234d8a8e463cedb2f41c8a, user_id=1356807fb3a14ede8cd8fc9eeeaab085, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:22.616213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:22.628100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1277/2550] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:22 2022] PUT /identity/v3/projects/f190c6d330234d8a8e463cedb2f41c8a/users/1356807fb3a14ede8cd8fc9eeeaab085/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:22.641319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc91b-65ef-43c5-afe8-581a9b6eda00 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:22.641604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc91b-65ef-43c5-afe8-581a9b6eda00 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:22.641876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc91b-65ef-43c5-afe8-581a9b6eda00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:22.675783 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-aeedc91b-65ef-43c5-afe8-581a9b6eda00 None None] MFA Rules not processed for user `1356807fb3a14ede8cd8fc9eeeaab085`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:22.677386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-aeedc91b-65ef-43c5-afe8-581a9b6eda00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:22.763813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1274/2551] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:22.775726 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:22.780548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:22.852990 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96aa9-c0d9-4908-ac47-64b6064b09bc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:22.856749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:22.857402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:22.857684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:22.857956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:22.867893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:22.869384 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:22.880377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1278/2552] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:23.107603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedc91b-65ef-43c5-afe8-581a9b6eda00 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:23.117824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedc91b-65ef-43c5-afe8-581a9b6eda00 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:23.121459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42369d89-8b57-412f-99a4-13a0172cac89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:23.122066 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369d89-8b57-412f-99a4-13a0172cac89 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:23.122348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369d89-8b57-412f-99a4-13a0172cac89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:23.122624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369d89-8b57-412f-99a4-13a0172cac89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:23.173062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:23.176874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:23.192856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42369d89-8b57-412f-99a4-13a0172cac89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:23.194598 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42369d89-8b57-412f-99a4-13a0172cac89 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:23.205556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1275/2553] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:23.266063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bce14-4883-4707-8904-ecd158e1bf11 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:23.270641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:23.271268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:23.271548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:23.271825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] PATH_INFO: `/v3/users/f259a5ece5e34146a633644f3bcc738c` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:23.272976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f259a5ece5e34146a633644f3bcc738c)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:23.275006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:23.472340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f259a5ece5e34146a633644f3bcc738c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:23.473030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f259a5ece5e34146a633644f3bcc738c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:23.475578 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:23.539140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f259a5ece5e34146a633644f3bcc738c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:23.540130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f259a5ece5e34146a633644f3bcc738c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:23.556752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f259a5ece5e34146a633644f3bcc738c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:23.570171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1279/2554] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:23 2022] DELETE /identity/v3/users/f259a5ece5e34146a633644f3bcc738c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:23.854687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42369d89-8b57-412f-99a4-13a0172cac89 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:23.865889 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42369d89-8b57-412f-99a4-13a0172cac89 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:23.876970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:23.930469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:23.931172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:23.931452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:23.931715 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] PATH_INFO: `/v3/projects/7041c1a49efa446abd82db109d33fba4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:23.932862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7041c1a49efa446abd82db109d33fba4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:23.934820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:24.038822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7041c1a49efa446abd82db109d33fba4', 'request_id': 'req-d0d9a895-5005-4ddd-a416-ad77d7420cd8'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.045059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7041c1a49efa446abd82db109d33fba4', 'request_id': 'req-d0d9a895-5005-4ddd-a416-ad77d7420cd8'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.050752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7041c1a49efa446abd82db109d33fba4', 'request_id': 'req-d0d9a895-5005-4ddd-a416-ad77d7420cd8'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.109416 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] The token cache is being invalidate because project 7041c1a49efa446abd82db109d33fba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:24.109710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.110384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.111899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1276/2555] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:23 2022] DELETE /identity/v3/projects/7041c1a49efa446abd82db109d33fba4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:24.116442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:24.117945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:24.131885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86230be-9906-4043-80a7-54c230f0923a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:24.200704 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:24.201428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:24.201624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:24.201896 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] PATH_INFO: `/v3/users/2e7293b691464881a53ff6c45e4c3f9f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:24.203024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7293b691464881a53ff6c45e4c3f9f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:24.204926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:24.399205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7293b691464881a53ff6c45e4c3f9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.399842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7293b691464881a53ff6c45e4c3f9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.464708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7293b691464881a53ff6c45e4c3f9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.464708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7293b691464881a53ff6c45e4c3f9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.476404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9e0120bc-4425-49a5-9fc6-d861f5c408ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7293b691464881a53ff6c45e4c3f9f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:24.490000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1280/2556] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:24 2022] DELETE /identity/v3/users/2e7293b691464881a53ff6c45e4c3f9f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:24.780466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:24.781682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:24.800278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a895-5005-4ddd-a416-ad77d7420cd8 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:24.880963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:24.882016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:24.882329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:24.882609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] PATH_INFO: `/v3/projects/95ef8ec448954333be17cfcea51e6de5` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:24.883931 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ef8ec448954333be17cfcea51e6de5)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:24.886016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:24.998461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:25.002353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ef8ec448954333be17cfcea51e6de5', 'request_id': 'req-2c530c2c-799a-4060-8645-56ceba6cbbeb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:25.010032 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ef8ec448954333be17cfcea51e6de5', 'request_id': 'req-2c530c2c-799a-4060-8645-56ceba6cbbeb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:25.016144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ef8ec448954333be17cfcea51e6de5', 'request_id': 'req-2c530c2c-799a-4060-8645-56ceba6cbbeb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:25.081486 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] The token cache is being invalidate because project 95ef8ec448954333be17cfcea51e6de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:25.082494 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:25.082913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2c530c2c-799a-4060-8645-56ceba6cbbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:25.084410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1277/2557] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:24 2022] DELETE /identity/v3/projects/95ef8ec448954333be17cfcea51e6de5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:25.089499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ae18-c7f1-4d87-9bb6-420763c08678 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.093886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ae18-c7f1-4d87-9bb6-420763c08678 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.093886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ae18-c7f1-4d87-9bb6-420763c08678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.111479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-97a6ae18-c7f1-4d87-9bb6-420763c08678 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:25.112695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-97a6ae18-c7f1-4d87-9bb6-420763c08678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:25.157645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:25.175974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1281/2558] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:25.184273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4169e37-ec58-4eaa-a3d2-29d9b29dd1c5 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.184565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4169e37-ec58-4eaa-a3d2-29d9b29dd1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.184844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4169e37-ec58-4eaa-a3d2-29d9b29dd1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.205370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e4169e37-ec58-4eaa-a3d2-29d9b29dd1c5 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:25.206589 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e4169e37-ec58-4eaa-a3d2-29d9b29dd1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:25.215252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1278/2559] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:25.219919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6ae18-c7f1-4d87-9bb6-420763c08678 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:25.230544 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6ae18-c7f1-4d87-9bb6-420763c08678 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:25.235270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:25.235880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.236164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.236444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.237153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:25.237451 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:25.239610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:25.253008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1282/2560] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:25.258247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4169e37-ec58-4eaa-a3d2-29d9b29dd1c5 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:25.268225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4169e37-ec58-4eaa-a3d2-29d9b29dd1c5 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:25.273399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655f0b5-9920-4836-ac51-65d6fa180b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:25.274701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655f0b5-9920-4836-ac51-65d6fa180b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.274701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655f0b5-9920-4836-ac51-65d6fa180b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.274701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655f0b5-9920-4836-ac51-65d6fa180b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.275250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655f0b5-9920-4836-ac51-65d6fa180b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:25.277238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655f0b5-9920-4836-ac51-65d6fa180b6f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:25.357345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1279/2561] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:25 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:25.361654 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:25.372475 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c026e-0b3e-42c0-8a6b-ac171177e977 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:25.440528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2ac9-b207-48cc-b4e2-9bfa0c18ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:25.441331 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2ac9-b207-48cc-b4e2-9bfa0c18ca0c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.441720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2ac9-b207-48cc-b4e2-9bfa0c18ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.442045 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2ac9-b207-48cc-b4e2-9bfa0c18ca0c admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.442928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f2ac9-b207-48cc-b4e2-9bfa0c18ca0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:25.444928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f2ac9-b207-48cc-b4e2-9bfa0c18ca0c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:25.532774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1283/2562] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:25 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:25.537713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655f0b5-9920-4836-ac51-65d6fa180b6f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:25.548513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655f0b5-9920-4836-ac51-65d6fa180b6f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:25.553993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1949684-435b-449a-97f7-ef03d8cba397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:25.554606 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1949684-435b-449a-97f7-ef03d8cba397 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.554883 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1949684-435b-449a-97f7-ef03d8cba397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.555415 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1949684-435b-449a-97f7-ef03d8cba397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.556076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1949684-435b-449a-97f7-ef03d8cba397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:25.557761 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1949684-435b-449a-97f7-ef03d8cba397 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:25.569626 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1280/2563] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:25.573576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2ac9-b207-48cc-b4e2-9bfa0c18ca0c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:25.584438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2ac9-b207-48cc-b4e2-9bfa0c18ca0c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:25.589150 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07622120-e12f-408c-8f8e-9284cdc924ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:25.589750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07622120-e12f-408c-8f8e-9284cdc924ef admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.590027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07622120-e12f-408c-8f8e-9284cdc924ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.590294 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07622120-e12f-408c-8f8e-9284cdc924ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.590941 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07622120-e12f-408c-8f8e-9284cdc924ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:25.592562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07622120-e12f-408c-8f8e-9284cdc924ef admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:25.605686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1284/2564] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:25.610155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1949684-435b-449a-97f7-ef03d8cba397 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:25.621195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1949684-435b-449a-97f7-ef03d8cba397 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:25.626171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:25.626832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.627117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.627394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] PATH_INFO: `/v3/projects/8fdec778029d4af196df74304aee4a08/users/8161fdfc420745be90dd74162822f5a6/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.642291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdec778029d4af196df74304aee4a08, user_id=8161fdfc420745be90dd74162822f5a6, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:25.644984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:25.791280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1281/2565] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:25 2022] PUT /identity/v3/projects/8fdec778029d4af196df74304aee4a08/users/8161fdfc420745be90dd74162822f5a6/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:25.805425 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4029a-660f-43a7-a4f8-43816d6f6a9b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.806174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4029a-660f-43a7-a4f8-43816d6f6a9b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.806801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4029a-660f-43a7-a4f8-43816d6f6a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.814488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:25.816985 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:25.851548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8ca4029a-660f-43a7-a4f8-43816d6f6a9b None None] MFA Rules not processed for user `8161fdfc420745be90dd74162822f5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:25.852773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8ca4029a-660f-43a7-a4f8-43816d6f6a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:25.894867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e4099-9694-4b51-8609-1dd966e59d98 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:25.899422 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:25.900046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:25.900330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:25.900599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:25.902642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:25.927002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1285/2566] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:25.940178 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4029a-660f-43a7-a4f8-43816d6f6a9b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:25.942630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8ca4029a-660f-43a7-a4f8-43816d6f6a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:25.981168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:25.982822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:25.993338 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:25.993654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1282/2567] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:26.010474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4029a-660f-43a7-a4f8-43816d6f6a9b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:26.023335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c976-9aab-4766-a450-f628a48715aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:26.023335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c976-9aab-4766-a450-f628a48715aa service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:26.023335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c976-9aab-4766-a450-f628a48715aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:26.023335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0c976-9aab-4766-a450-f628a48715aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:26.026502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c976-9aab-4766-a450-f628a48715aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:26.028267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0c976-9aab-4766-a450-f628a48715aa service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:26.041913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1286/2568] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:38:32.845882 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:32.847351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:32.859274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a41ec-4d01-4f30-ad0a-ef5314823e37 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:32.863312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c3619-7efa-4bf6-814d-7231d56ba031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:32.863970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3619-7efa-4bf6-814d-7231d56ba031 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:32.866694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3619-7efa-4bf6-814d-7231d56ba031 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:32.866694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c3619-7efa-4bf6-814d-7231d56ba031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:32.866694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-708c3619-7efa-4bf6-814d-7231d56ba031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:32.897821 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:32.952665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c3619-7efa-4bf6-814d-7231d56ba031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:32.954424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c3619-7efa-4bf6-814d-7231d56ba031 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:32.965964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1283/2569] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:38:33.578469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c976-9aab-4766-a450-f628a48715aa service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:33.594866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0c976-9aab-4766-a450-f628a48715aa service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:33.603064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:33.603725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:33.604009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:33.604286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] PATH_INFO: `/v3/users/8161fdfc420745be90dd74162822f5a6` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:33.605622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8161fdfc420745be90dd74162822f5a6)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:33.616506 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:33.846303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8161fdfc420745be90dd74162822f5a6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:33.846985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8161fdfc420745be90dd74162822f5a6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:33.915375 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8161fdfc420745be90dd74162822f5a6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:33.916153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8161fdfc420745be90dd74162822f5a6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:33.932626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8161fdfc420745be90dd74162822f5a6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:33.947257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1287/2570] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:33 2022] DELETE /identity/v3/users/8161fdfc420745be90dd74162822f5a6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:33.952333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a87c7-b572-44de-8663-550f487f836f None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:33.952999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a87c7-b572-44de-8663-550f487f836f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:33.952999 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a87c7-b572-44de-8663-550f487f836f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:33.978061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a74a87c7-b572-44de-8663-550f487f836f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:33.979991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a74a87c7-b572-44de-8663-550f487f836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:34.072441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1284/2571] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:34.092564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:34.092564 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:34.189033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d2b6f-b6aa-4d89-aa9d-d427cc0c2b69 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:34.199286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235b467-eaee-446d-97f0-d1ad01facae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:34.199923 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b467-eaee-446d-97f0-d1ad01facae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:34.200220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b467-eaee-446d-97f0-d1ad01facae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:34.200490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b467-eaee-446d-97f0-d1ad01facae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:34.220226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235b467-eaee-446d-97f0-d1ad01facae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:34.221786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235b467-eaee-446d-97f0-d1ad01facae1 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:34.239779 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1288/2572] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:34.816364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a87c7-b572-44de-8663-550f487f836f None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:34.820940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a74a87c7-b572-44de-8663-550f487f836f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:34.859127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a87c7-b572-44de-8663-550f487f836f None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:34.870174 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:34.871134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:34.871574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:34.872160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] PATH_INFO: `/v3/projects/8fdec778029d4af196df74304aee4a08` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:34.874570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdec778029d4af196df74304aee4a08)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:34.877439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:35.055496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdec778029d4af196df74304aee4a08', 'request_id': 'req-63887863-d086-47bb-be64-b9a382784efb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:35.082013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdec778029d4af196df74304aee4a08', 'request_id': 'req-63887863-d086-47bb-be64-b9a382784efb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:35.101163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdec778029d4af196df74304aee4a08', 'request_id': 'req-63887863-d086-47bb-be64-b9a382784efb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:35.228159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] The token cache is being invalidate because project 8fdec778029d4af196df74304aee4a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:35.228923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:35.229742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-63887863-d086-47bb-be64-b9a382784efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:35.231645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1285/2573] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:34 2022] DELETE /identity/v3/projects/8fdec778029d4af196df74304aee4a08 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:35.238097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabda235-3913-44b4-8830-46bd6dde59f6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:35.238696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabda235-3913-44b4-8830-46bd6dde59f6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:35.238803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabda235-3913-44b4-8830-46bd6dde59f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:35.261523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fabda235-3913-44b4-8830-46bd6dde59f6 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:35.263079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fabda235-3913-44b4-8830-46bd6dde59f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:35.328586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:35.343678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1289/2574] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:35.348071 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bf6da-050d-42cd-b2a0-c4cb3351981f None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:35.348345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bf6da-050d-42cd-b2a0-c4cb3351981f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:35.348625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bf6da-050d-42cd-b2a0-c4cb3351981f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:35.372762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0e1bf6da-050d-42cd-b2a0-c4cb3351981f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:35.374968 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0e1bf6da-050d-42cd-b2a0-c4cb3351981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:35.386407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1286/2575] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:35.391773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabda235-3913-44b4-8830-46bd6dde59f6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:35.408020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabda235-3913-44b4-8830-46bd6dde59f6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:35.414127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:35.415256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:35.415695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:35.417316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:35.418158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:35.418469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:35.422368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:35.445269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bf6da-050d-42cd-b2a0-c4cb3351981f None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:35.458421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1290/2576] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:35.460537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bf6da-050d-42cd-b2a0-c4cb3351981f None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:35.472829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ad126-eded-45b5-a7e9-38b50099597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:35.472829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ad126-eded-45b5-a7e9-38b50099597c admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:35.472829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ad126-eded-45b5-a7e9-38b50099597c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:35.472829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ad126-eded-45b5-a7e9-38b50099597c admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:35.473520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ad126-eded-45b5-a7e9-38b50099597c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:35.476345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ad126-eded-45b5-a7e9-38b50099597c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:35.641310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1287/2577] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:35 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:35.645377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:35.658673 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871c9b6-47ba-4e70-b891-4dc2f1b6bb4d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:35.719391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644166b9-ab49-478d-9a6c-8fb2d01113fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:35.720063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644166b9-ab49-478d-9a6c-8fb2d01113fa admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:35.720349 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644166b9-ab49-478d-9a6c-8fb2d01113fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:35.720643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644166b9-ab49-478d-9a6c-8fb2d01113fa admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:35.721322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644166b9-ab49-478d-9a6c-8fb2d01113fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:35.723927 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644166b9-ab49-478d-9a6c-8fb2d01113fa admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:35.837126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1291/2578] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:35 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:35.842518 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ad126-eded-45b5-a7e9-38b50099597c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:35.857145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ad126-eded-45b5-a7e9-38b50099597c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:35.862597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc23aab-285a-4c47-a737-ef7bfbdd1624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:35.863539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc23aab-285a-4c47-a737-ef7bfbdd1624 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:35.863823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc23aab-285a-4c47-a737-ef7bfbdd1624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:35.864130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc23aab-285a-4c47-a737-ef7bfbdd1624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:35.865100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc23aab-285a-4c47-a737-ef7bfbdd1624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:35.867017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc23aab-285a-4c47-a737-ef7bfbdd1624 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:35.880056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:35.885709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1288/2579] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:35.890623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644166b9-ab49-478d-9a6c-8fb2d01113fa admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:35.908682 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644166b9-ab49-478d-9a6c-8fb2d01113fa admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:35.919304 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8586-d632-451c-bab1-ef6cb5fe576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:35.921326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8586-d632-451c-bab1-ef6cb5fe576d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:35.921829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8586-d632-451c-bab1-ef6cb5fe576d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:35.922389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8586-d632-451c-bab1-ef6cb5fe576d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:35.923220 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da8586-d632-451c-bab1-ef6cb5fe576d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:35.926465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da8586-d632-451c-bab1-ef6cb5fe576d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:35.940827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1292/2580] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:35.944834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc23aab-285a-4c47-a737-ef7bfbdd1624 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:35.957303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc23aab-285a-4c47-a737-ef7bfbdd1624 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:35.971958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:35.972787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:35.973144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:35.973430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] PATH_INFO: `/v3/projects/b9ffc1787bc34f56b50fd913abcaaf34/users/c1de610a786549a7b4d16fabc35c37b9/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:35.992074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ffc1787bc34f56b50fd913abcaaf34, user_id=c1de610a786549a7b4d16fabc35c37b9, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:35.995758 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:36.093595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1289/2581] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:35 2022] PUT /identity/v3/projects/b9ffc1787bc34f56b50fd913abcaaf34/users/c1de610a786549a7b4d16fabc35c37b9/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:36.099233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce175c-fb18-42b2-991a-d020fb0f24d3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:36.100160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce175c-fb18-42b2-991a-d020fb0f24d3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:36.100160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce175c-fb18-42b2-991a-d020fb0f24d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:36.121041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-bcce175c-fb18-42b2-991a-d020fb0f24d3 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:36.122322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bcce175c-fb18-42b2-991a-d020fb0f24d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:36.196430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1293/2582] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:36.216392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:36.216392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:36.255789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce175c-fb18-42b2-991a-d020fb0f24d3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:36.257440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bcce175c-fb18-42b2-991a-d020fb0f24d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:36.275583 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce175c-fb18-42b2-991a-d020fb0f24d3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:36.286558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:36.287565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:36.287565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:36.287880 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] PATH_INFO: `/v3/users/eb88b51e35f44e94b56de903b8e203c7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:36.289203 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb88b51e35f44e94b56de903b8e203c7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:36.291993 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:36.314504 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd4da5-be30-41c0-a9b2-38beebde339f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:36.320887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0678a8-db5a-4ab5-9cac-4c173e7d6489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:36.321640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0678a8-db5a-4ab5-9cac-4c173e7d6489 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:36.321990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0678a8-db5a-4ab5-9cac-4c173e7d6489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:36.322332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0678a8-db5a-4ab5-9cac-4c173e7d6489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:36.334266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0678a8-db5a-4ab5-9cac-4c173e7d6489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:36.335734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0678a8-db5a-4ab5-9cac-4c173e7d6489 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:36.347040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1290/2583] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:36.586017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb88b51e35f44e94b56de903b8e203c7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:36.586743 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb88b51e35f44e94b56de903b8e203c7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:36.681668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb88b51e35f44e94b56de903b8e203c7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:36.682766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb88b51e35f44e94b56de903b8e203c7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:36.692012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:36.719262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb88b51e35f44e94b56de903b8e203c7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:36.735095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1294/2584] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:36 2022] DELETE /identity/v3/users/eb88b51e35f44e94b56de903b8e203c7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:36.740565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d22c-92e2-499b-8278-e44d6c2094cd None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:36.740860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d22c-92e2-499b-8278-e44d6c2094cd None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:36.741192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561d22c-92e2-499b-8278-e44d6c2094cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:36.760869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-7561d22c-92e2-499b-8278-e44d6c2094cd None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:36.762124 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7561d22c-92e2-499b-8278-e44d6c2094cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:36.839581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1291/2585] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:36.850221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:36.852055 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:36.948434 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab37f-d067-481c-a079-ec028955aedf admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:36.953269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76460b-1192-441b-8912-9c4d7f242626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:36.954079 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76460b-1192-441b-8912-9c4d7f242626 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:36.954541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76460b-1192-441b-8912-9c4d7f242626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:36.958794 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76460b-1192-441b-8912-9c4d7f242626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:36.966346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76460b-1192-441b-8912-9c4d7f242626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:36.967799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76460b-1192-441b-8912-9c4d7f242626 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:36.979393 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1295/2586] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:37.623378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561d22c-92e2-499b-8278-e44d6c2094cd None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:37.625874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7561d22c-92e2-499b-8278-e44d6c2094cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:37.641737 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561d22c-92e2-499b-8278-e44d6c2094cd None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:37.647690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:37.648443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:37.649618 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:37.650007 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] PATH_INFO: `/v3/projects/54d7ef7065b042b68429a6801c14b865` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:37.651321 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d7ef7065b042b68429a6801c14b865)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:37.654195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:37.860591 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d7ef7065b042b68429a6801c14b865', 'request_id': 'req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:37.867801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d7ef7065b042b68429a6801c14b865', 'request_id': 'req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:37.880185 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d7ef7065b042b68429a6801c14b865', 'request_id': 'req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:37.979078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] The token cache is being invalidate because project 54d7ef7065b042b68429a6801c14b865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:37.979788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:37.980827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ab6c8dce-45d9-4df3-b90e-d1ff16fc5b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:37.983313 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1292/2587] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:37 2022] DELETE /identity/v3/projects/54d7ef7065b042b68429a6801c14b865 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:37.995248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0cd9-73f4-499b-a936-1812ad5bec91 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:37.997195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0cd9-73f4-499b-a936-1812ad5bec91 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:37.997750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e0cd9-73f4-499b-a936-1812ad5bec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.020324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-993e0cd9-73f4-499b-a936-1812ad5bec91 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:38.022549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-993e0cd9-73f4-499b-a936-1812ad5bec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:38.112999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1296/2588] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:38.130425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0b6be-f582-4ae0-a528-392a9744a694 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.130858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0b6be-f582-4ae0-a528-392a9744a694 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.131141 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0b6be-f582-4ae0-a528-392a9744a694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.133563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb26a5-fa23-43e4-84f2-c0db2932a365 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.133844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb26a5-fa23-43e4-84f2-c0db2932a365 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.134249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb26a5-fa23-43e4-84f2-c0db2932a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.142827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:38.160102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-74f0b6be-f582-4ae0-a528-392a9744a694 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:38.161348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-74f0b6be-f582-4ae0-a528-392a9744a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:38.167252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4eeb26a5-fa23-43e4-84f2-c0db2932a365 None None] MFA Rules not processed for user `c1de610a786549a7b4d16fabc35c37b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:38.168664 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4eeb26a5-fa23-43e4-84f2-c0db2932a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:38.170287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1293/2589] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:38.175407 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0b6be-f582-4ae0-a528-392a9744a694 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:38.185676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0b6be-f582-4ae0-a528-392a9744a694 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:38.191033 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:38.192180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.192511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.192793 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.193500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:38.193835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:38.195474 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:38.208563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1294/2590] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:38:38.212778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:38.223017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f3171-7148-4a53-bf50-32c6f84045f8 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:38.230432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fbe02-0b7a-45e4-a077-739261847767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:38.230432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fbe02-0b7a-45e4-a077-739261847767 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.230432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fbe02-0b7a-45e4-a077-739261847767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.230432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fbe02-0b7a-45e4-a077-739261847767 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.230898 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fbe02-0b7a-45e4-a077-739261847767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:38.231829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fbe02-0b7a-45e4-a077-739261847767 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:38.258327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1297/2591] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:38.270399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb26a5-fa23-43e4-84f2-c0db2932a365 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:38.271739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4eeb26a5-fa23-43e4-84f2-c0db2932a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:38.285034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:38.331149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb26a5-fa23-43e4-84f2-c0db2932a365 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:38.335378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65e52d-d09a-4a63-acf1-6028ddb0ba08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:38.335988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e52d-d09a-4a63-acf1-6028ddb0ba08 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.336268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e52d-d09a-4a63-acf1-6028ddb0ba08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.336542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65e52d-d09a-4a63-acf1-6028ddb0ba08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.345200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65e52d-d09a-4a63-acf1-6028ddb0ba08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:38.346623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65e52d-d09a-4a63-acf1-6028ddb0ba08 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:38.357090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1298/2592] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:38:38.371646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1295/2593] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:38 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:38.375561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65e52d-d09a-4a63-acf1-6028ddb0ba08 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:38.389712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65e52d-d09a-4a63-acf1-6028ddb0ba08 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:38.466447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ea01-de34-4057-97e8-86e626e22052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:38.467120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ea01-de34-4057-97e8-86e626e22052 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.467413 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ea01-de34-4057-97e8-86e626e22052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.467689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1ea01-de34-4057-97e8-86e626e22052 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.468341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1ea01-de34-4057-97e8-86e626e22052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:38.470653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1ea01-de34-4057-97e8-86e626e22052 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:38.573125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1299/2594] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:38 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:38.593658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fbe02-0b7a-45e4-a077-739261847767 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:38.604993 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fbe02-0b7a-45e4-a077-739261847767 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:38.609926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c50d-de1a-4f1a-b2fb-a0c426e01169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:38.610550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c50d-de1a-4f1a-b2fb-a0c426e01169 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.610830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c50d-de1a-4f1a-b2fb-a0c426e01169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.611097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c50d-de1a-4f1a-b2fb-a0c426e01169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.611841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73c50d-de1a-4f1a-b2fb-a0c426e01169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:38.614067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73c50d-de1a-4f1a-b2fb-a0c426e01169 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:38.634479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1296/2595] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:38.641181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ea01-de34-4057-97e8-86e626e22052 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:38.659145 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1ea01-de34-4057-97e8-86e626e22052 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:38.669550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727e5ca-d93e-4945-ba13-3dc0d46e2d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:38.670493 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e5ca-d93e-4945-ba13-3dc0d46e2d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.670949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e5ca-d93e-4945-ba13-3dc0d46e2d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.671508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727e5ca-d93e-4945-ba13-3dc0d46e2d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.672205 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727e5ca-d93e-4945-ba13-3dc0d46e2d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:38.677540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727e5ca-d93e-4945-ba13-3dc0d46e2d43 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:38.688632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1300/2596] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:38:38.690722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c50d-de1a-4f1a-b2fb-a0c426e01169 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:38.703126 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c50d-de1a-4f1a-b2fb-a0c426e01169 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:38.709220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429173bf-56ed-4879-ae3c-9b6fe3da19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:38.709636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429173bf-56ed-4879-ae3c-9b6fe3da19f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.709920 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429173bf-56ed-4879-ae3c-9b6fe3da19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.710199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429173bf-56ed-4879-ae3c-9b6fe3da19f5 admin admin] PATH_INFO: `/v3/projects/97b45363955b451cb2a2c1c31e4e99c4/users/41fdd3dbb8e84d4385792dbc7fa12dca/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.737581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429173bf-56ed-4879-ae3c-9b6fe3da19f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b45363955b451cb2a2c1c31e4e99c4, user_id=41fdd3dbb8e84d4385792dbc7fa12dca, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:38.740367 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429173bf-56ed-4879-ae3c-9b6fe3da19f5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:38.853904 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1297/2597] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:38 2022] PUT /identity/v3/projects/97b45363955b451cb2a2c1c31e4e99c4/users/41fdd3dbb8e84d4385792dbc7fa12dca/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:38.925561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129747ca-7aee-48d6-9c12-4618524356c4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:38.925992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129747ca-7aee-48d6-9c12-4618524356c4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:38.926312 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129747ca-7aee-48d6-9c12-4618524356c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:38.956253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-129747ca-7aee-48d6-9c12-4618524356c4 None None] MFA Rules not processed for user `41fdd3dbb8e84d4385792dbc7fa12dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:38.958142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-129747ca-7aee-48d6-9c12-4618524356c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:39.062959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1301/2598] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:39.065870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429173bf-56ed-4879-ae3c-9b6fe3da19f5 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:39.193844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429173bf-56ed-4879-ae3c-9b6fe3da19f5 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:39.211493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd444cb-73ba-4431-b4cb-a869497f03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:39.212063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd444cb-73ba-4431-b4cb-a869497f03d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:39.212345 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd444cb-73ba-4431-b4cb-a869497f03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:39.212656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd444cb-73ba-4431-b4cb-a869497f03d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:39.213327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd444cb-73ba-4431-b4cb-a869497f03d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:39.215496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd444cb-73ba-4431-b4cb-a869497f03d5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:39.368648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1298/2599] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:39 2022] POST /identity/v3/projects => generated 385 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:39.375233 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129747ca-7aee-48d6-9c12-4618524356c4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:39.389945 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129747ca-7aee-48d6-9c12-4618524356c4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:39.473821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4d704-0157-4b2a-bec8-04e0fb6de2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:39.474454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d704-0157-4b2a-bec8-04e0fb6de2de admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:39.474737 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d704-0157-4b2a-bec8-04e0fb6de2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:39.475044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d704-0157-4b2a-bec8-04e0fb6de2de admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:39.475724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4d704-0157-4b2a-bec8-04e0fb6de2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:39.493206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4d704-0157-4b2a-bec8-04e0fb6de2de admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:39.493206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:39.636680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1302/2600] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:39 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:39.642633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd444cb-73ba-4431-b4cb-a869497f03d5 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:39.666094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd444cb-73ba-4431-b4cb-a869497f03d5 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:39.683388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46154-e493-4f90-ae06-92af0051df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:39.684372 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46154-e493-4f90-ae06-92af0051df57 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:39.684664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46154-e493-4f90-ae06-92af0051df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:39.684988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46154-e493-4f90-ae06-92af0051df57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:39.691890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d46154-e493-4f90-ae06-92af0051df57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:39.693637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d46154-e493-4f90-ae06-92af0051df57 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:39.714590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1299/2601] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:38:39.719769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4d704-0157-4b2a-bec8-04e0fb6de2de admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:39.732149 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4d704-0157-4b2a-bec8-04e0fb6de2de admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:39.741553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff17f91-c082-4895-a320-b5eff88891f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:39.745525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17f91-c082-4895-a320-b5eff88891f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:39.745525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17f91-c082-4895-a320-b5eff88891f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:39.745525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17f91-c082-4895-a320-b5eff88891f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:39.745525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff17f91-c082-4895-a320-b5eff88891f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:39.745525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff17f91-c082-4895-a320-b5eff88891f8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:39.756011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1303/2602] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:39.760025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46154-e493-4f90-ae06-92af0051df57 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:39.770099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46154-e493-4f90-ae06-92af0051df57 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:39.774658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19fd12-2040-4c68-8e7e-908018cfc00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:39.775319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19fd12-2040-4c68-8e7e-908018cfc00d admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:39.775600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19fd12-2040-4c68-8e7e-908018cfc00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:39.775874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19fd12-2040-4c68-8e7e-908018cfc00d admin admin] PATH_INFO: `/v3/projects/79442a0de04f48b297dc4defebf07e60/users/df7fe7047cf64eb8a1b4add816ddaec0/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:39.796585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19fd12-2040-4c68-8e7e-908018cfc00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79442a0de04f48b297dc4defebf07e60, user_id=df7fe7047cf64eb8a1b4add816ddaec0, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:39.799772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19fd12-2040-4c68-8e7e-908018cfc00d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:39.928584 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1300/2603] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:39 2022] PUT /identity/v3/projects/79442a0de04f48b297dc4defebf07e60/users/df7fe7047cf64eb8a1b4add816ddaec0/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:39.945969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77e7a-6296-4f3f-bc27-1c518214ce21 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:39.946258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77e7a-6296-4f3f-bc27-1c518214ce21 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:39.946541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e77e7a-6296-4f3f-bc27-1c518214ce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:39.975645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d3e77e7a-6296-4f3f-bc27-1c518214ce21 None None] MFA Rules not processed for user `df7fe7047cf64eb8a1b4add816ddaec0`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:39.976811 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d3e77e7a-6296-4f3f-bc27-1c518214ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:40.057063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1304/2604] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:40.061830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19fd12-2040-4c68-8e7e-908018cfc00d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:40.151925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:40.192648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19fd12-2040-4c68-8e7e-908018cfc00d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:40.199122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6c7e8-1f4e-4329-ab1b-c8ae0e353eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:40.199674 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6c7e8-1f4e-4329-ab1b-c8ae0e353eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:40.199963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6c7e8-1f4e-4329-ab1b-c8ae0e353eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:40.200245 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6c7e8-1f4e-4329-ab1b-c8ae0e353eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:40.200973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6c7e8-1f4e-4329-ab1b-c8ae0e353eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:40.203132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6c7e8-1f4e-4329-ab1b-c8ae0e353eaf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:40.314325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1301/2605] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:40 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:40.318643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e77e7a-6296-4f3f-bc27-1c518214ce21 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:40.338192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e77e7a-6296-4f3f-bc27-1c518214ce21 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:40.470651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d5cbc-c4a4-4007-a98e-4b4cc91a216c None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:40.470944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d5cbc-c4a4-4007-a98e-4b4cc91a216c None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:40.471224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d5cbc-c4a4-4007-a98e-4b4cc91a216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:40.484047 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2f6a7-178e-45d8-924d-a3b732e21787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:40.485350 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2f6a7-178e-45d8-924d-a3b732e21787 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:40.486195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2f6a7-178e-45d8-924d-a3b732e21787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:40.486852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2f6a7-178e-45d8-924d-a3b732e21787 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:40.487741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2f6a7-178e-45d8-924d-a3b732e21787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:40.490851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2f6a7-178e-45d8-924d-a3b732e21787 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:40.496755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-356d5cbc-c4a4-4007-a98e-4b4cc91a216c None None] MFA Rules not processed for user `c1de610a786549a7b4d16fabc35c37b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:40.499091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-356d5cbc-c4a4-4007-a98e-4b4cc91a216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:40.601900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1302/2606] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:38:40.638279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1305/2607] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:40 2022] POST /identity/v3/users => generated 299 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:40.639110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d5cbc-c4a4-4007-a98e-4b4cc91a216c None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:40.659559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d5cbc-c4a4-4007-a98e-4b4cc91a216c None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:40.668235 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b93f00-acbe-4ef5-b19a-514f87af255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:40.668867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93f00-acbe-4ef5-b19a-514f87af255d admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:40.669170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93f00-acbe-4ef5-b19a-514f87af255d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:40.669441 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93f00-acbe-4ef5-b19a-514f87af255d admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:40.670087 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b93f00-acbe-4ef5-b19a-514f87af255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:40.671679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b93f00-acbe-4ef5-b19a-514f87af255d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:40.696498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1303/2608] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:40.704548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2f6a7-178e-45d8-924d-a3b732e21787 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:40.722126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2f6a7-178e-45d8-924d-a3b732e21787 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:40.728097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:40.729032 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:40.729422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:40.729562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] PATH_INFO: `/v3/projects/4b6b2a656b4245d5908751be059e3b72/users/dfe059519398468a897d81bc172d8e8a/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:40.747517 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6b2a656b4245d5908751be059e3b72, user_id=dfe059519398468a897d81bc172d8e8a, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:40.750293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:40.754456 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:40.870518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1306/2609] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:40 2022] PUT /identity/v3/projects/4b6b2a656b4245d5908751be059e3b72/users/dfe059519398468a897d81bc172d8e8a/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:40.874763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b93f00-acbe-4ef5-b19a-514f87af255d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:40.885548 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b93f00-acbe-4ef5-b19a-514f87af255d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:40.947008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:40.949525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:40.962437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189ff1-60b2-49be-a52f-17087537ff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:40.963108 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189ff1-60b2-49be-a52f-17087537ff94 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:40.963400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189ff1-60b2-49be-a52f-17087537ff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:40.963671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189ff1-60b2-49be-a52f-17087537ff94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:40.964315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189ff1-60b2-49be-a52f-17087537ff94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:40.966239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189ff1-60b2-49be-a52f-17087537ff94 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:40.985342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1304/2610] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:40.992559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189ff1-60b2-49be-a52f-17087537ff94 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:41.006106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189ff1-60b2-49be-a52f-17087537ff94 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:41.015778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae6732-b610-4c0a-8d3e-1cfb8206aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:41.019378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae6732-b610-4c0a-8d3e-1cfb8206aa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:41.019378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae6732-b610-4c0a-8d3e-1cfb8206aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:41.019378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae6732-b610-4c0a-8d3e-1cfb8206aa96 admin admin] PATH_INFO: `/v3/projects/4b6b2a656b4245d5908751be059e3b72/users/dfe059519398468a897d81bc172d8e8a/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:41.035160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae6732-b610-4c0a-8d3e-1cfb8206aa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6b2a656b4245d5908751be059e3b72, user_id=dfe059519398468a897d81bc172d8e8a, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:41.038512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae6732-b610-4c0a-8d3e-1cfb8206aa96 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:41.064130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2bf96-3bb9-41c6-a9c5-6cf09a4948e2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:41.068501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1305/2611] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:40 2022] PUT /identity/v3/projects/4b6b2a656b4245d5908751be059e3b72/users/dfe059519398468a897d81bc172d8e8a/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:41.080086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24fe9e-1a27-40ee-885c-c8afc26aa1b0 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:41.080586 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24fe9e-1a27-40ee-885c-c8afc26aa1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:41.080856 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24fe9e-1a27-40ee-885c-c8afc26aa1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:41.134576 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ea24fe9e-1a27-40ee-885c-c8afc26aa1b0 None None] MFA Rules not processed for user `dfe059519398468a897d81bc172d8e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:41.135899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ea24fe9e-1a27-40ee-885c-c8afc26aa1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:41.182233 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:41.194852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:41.195633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:41.196020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:41.196402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:41.200912 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:41.218446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:41.220224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:41.237134 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1307/2612] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:38:41.240222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1306/2613] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:38:41.260222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:41.335421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6902f-92fb-4118-a6cf-67072eea4df4 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:41.341483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876d62-8a6e-48e1-af63-ec8c3ae6a0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:41.342441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876d62-8a6e-48e1-af63-ec8c3ae6a0aa service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:41.342780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876d62-8a6e-48e1-af63-ec8c3ae6a0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:41.343081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876d62-8a6e-48e1-af63-ec8c3ae6a0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:41.435282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876d62-8a6e-48e1-af63-ec8c3ae6a0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:41.436790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876d62-8a6e-48e1-af63-ec8c3ae6a0aa service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:41.451536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1308/2614] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:42.926741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24fe9e-1a27-40ee-885c-c8afc26aa1b0 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:42.928316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ea24fe9e-1a27-40ee-885c-c8afc26aa1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:43.019871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24fe9e-1a27-40ee-885c-c8afc26aa1b0 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:43.026425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:43.027089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:43.027384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:43.027854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] PATH_INFO: `/v3/users/8b1c1310495a40da827afe14c09178b4` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:43.029314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1c1310495a40da827afe14c09178b4)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:43.031603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:43.302438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1c1310495a40da827afe14c09178b4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:43.303750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1c1310495a40da827afe14c09178b4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:43.420988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1c1310495a40da827afe14c09178b4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:43.476488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1c1310495a40da827afe14c09178b4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:43.477362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1c1310495a40da827afe14c09178b4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:43.510952 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1307/2615] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:42 2022] DELETE /identity/v3/users/8b1c1310495a40da827afe14c09178b4 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:43.972254 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876d62-8a6e-48e1-af63-ec8c3ae6a0aa service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:43.987262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876d62-8a6e-48e1-af63-ec8c3ae6a0aa service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:43.993759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:44.072881 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:44.077221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:44.078269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:44.078631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:44.088404 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:44.089078 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] PATH_INFO: `/v3/projects/f02046b41a4749b3987b7a72bb3af83d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:44.102882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02046b41a4749b3987b7a72bb3af83d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:44.108053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:44.195028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:44.234242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b2c79-e873-4351-acd3-78060393726b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:44.242209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:44.242825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:44.243106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:44.243377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:44.245866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:44.324180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02046b41a4749b3987b7a72bb3af83d', 'request_id': 'req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.341012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02046b41a4749b3987b7a72bb3af83d', 'request_id': 'req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.358222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02046b41a4749b3987b7a72bb3af83d', 'request_id': 'req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.409119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:44.411389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:44.422052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1308/2616] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:44.422837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:44.427835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:44.458880 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de965a7-db4f-44dc-a427-f96c63855a85 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:44.489616 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] The token cache is being invalidate because project f02046b41a4749b3987b7a72bb3af83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:44.489975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.491038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.495998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1309/2617] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:43 2022] DELETE /identity/v3/projects/f02046b41a4749b3987b7a72bb3af83d => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:44.500897 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:44.503855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:44.569287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:44.569948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:44.570501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:44.571055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] PATH_INFO: `/v3/users/ab4e36a634434e1abe0c2864adf6c5f1` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:44.572423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4e36a634434e1abe0c2864adf6c5f1)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:44.574430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:44.606518 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2c953-ed7e-4e6c-8907-4b9c5c37d0af admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:44.611751 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:44.612483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:44.616932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:44.616932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] PATH_INFO: `/v3/users/aad64e1ecdf44fb3bf40615cac011b8f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:44.616932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad64e1ecdf44fb3bf40615cac011b8f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:44.616932 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:44.796028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4e36a634434e1abe0c2864adf6c5f1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.796846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4e36a634434e1abe0c2864adf6c5f1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.881218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:44.887130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad64e1ecdf44fb3bf40615cac011b8f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.887817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad64e1ecdf44fb3bf40615cac011b8f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.905184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4e36a634434e1abe0c2864adf6c5f1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.921259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4e36a634434e1abe0c2864adf6c5f1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.922147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-28941e53-2e22-46c9-b193-6af8bdeeb22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4e36a634434e1abe0c2864adf6c5f1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:44.949850 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1309/2618] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:44 2022] DELETE /identity/v3/users/ab4e36a634434e1abe0c2864adf6c5f1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:44.954648 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3367-dc90-4f57-927d-2451efd11415 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:44.955086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3367-dc90-4f57-927d-2451efd11415 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:44.955471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3367-dc90-4f57-927d-2451efd11415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:44.995253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-0dbe3367-dc90-4f57-927d-2451efd11415 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:44.996536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0dbe3367-dc90-4f57-927d-2451efd11415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:45.008763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:45.013984 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad64e1ecdf44fb3bf40615cac011b8f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:45.019143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad64e1ecdf44fb3bf40615cac011b8f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:45.033954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad64e1ecdf44fb3bf40615cac011b8f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:45.053781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1310/2619] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:44 2022] DELETE /identity/v3/users/aad64e1ecdf44fb3bf40615cac011b8f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:45.100734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1310/2620] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:45.116213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:45.118293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:45.210092 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc80f-93dd-4382-834e-9b090dcadd68 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:45.215246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:45.215986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:45.216264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:45.216939 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:45.306559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:45.309555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:45.326025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1311/2621] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:38:45.432997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe3367-dc90-4f57-927d-2451efd11415 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:45.435613 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-0dbe3367-dc90-4f57-927d-2451efd11415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:45.464039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe3367-dc90-4f57-927d-2451efd11415 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:45.476692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:45.476692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:45.476692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:45.476692 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] PATH_INFO: `/v3/projects/3d841ef184ec452cac6058c65eb890d6` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:45.477060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d841ef184ec452cac6058c65eb890d6)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:45.479111 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:45.645122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d841ef184ec452cac6058c65eb890d6', 'request_id': 'req-bc2894c7-1211-40e6-a0f5-9343b85cf027'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:45.661402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d841ef184ec452cac6058c65eb890d6', 'request_id': 'req-bc2894c7-1211-40e6-a0f5-9343b85cf027'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:45.672615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d841ef184ec452cac6058c65eb890d6', 'request_id': 'req-bc2894c7-1211-40e6-a0f5-9343b85cf027'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:45.828610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] The token cache is being invalidate because project 3d841ef184ec452cac6058c65eb890d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:45.829120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:45.830204 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:45.876700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1311/2622] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:45 2022] DELETE /identity/v3/projects/3d841ef184ec452cac6058c65eb890d6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:46.327892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:46.333005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:46.405422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba93d2-b2e9-46f6-85aa-554a482270cb service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:46.485431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:46.492048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:46.538036 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:46.538879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:46.539266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:46.539638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] PATH_INFO: `/v3/projects/ea64010fec804fd2afffc4fcb59acd0e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:46.541416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea64010fec804fd2afffc4fcb59acd0e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:46.543576 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:46.555481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:46.561439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2894c7-1211-40e6-a0f5-9343b85cf027 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:46.565269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:46.565887 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:46.566698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:46.566971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:46.569104 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:46.658877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:46.667253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea64010fec804fd2afffc4fcb59acd0e', 'request_id': 'req-a2bf2603-0713-4088-a193-dce4de218932'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:46.675076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea64010fec804fd2afffc4fcb59acd0e', 'request_id': 'req-a2bf2603-0713-4088-a193-dce4de218932'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:46.685085 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea64010fec804fd2afffc4fcb59acd0e', 'request_id': 'req-a2bf2603-0713-4088-a193-dce4de218932'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:46.686854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:46.690553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:46.715036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1312/2623] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:38:46.779524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] The token cache is being invalidate because project ea64010fec804fd2afffc4fcb59acd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:46.779883 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:46.780730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:46.782676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1312/2624] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:46 2022] DELETE /identity/v3/projects/ea64010fec804fd2afffc4fcb59acd0e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:46.788481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:46.790908 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:46.829102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd317da-fd08-493d-b229-a76b7b14cf11 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:46.918582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:46.919105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:46.919382 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:46.919650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] PATH_INFO: `/v3/users/1356807fb3a14ede8cd8fc9eeeaab085` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:46.921086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1356807fb3a14ede8cd8fc9eeeaab085)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:46.923046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:47.217451 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1356807fb3a14ede8cd8fc9eeeaab085'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:47.218852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1356807fb3a14ede8cd8fc9eeeaab085'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:47.343819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1356807fb3a14ede8cd8fc9eeeaab085'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:47.357912 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1356807fb3a14ede8cd8fc9eeeaab085'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:47.358927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4f1b7b6d-e1d0-4449-9cb4-1b1611656d9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1356807fb3a14ede8cd8fc9eeeaab085'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:47.380570 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1313/2625] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:46 2022] DELETE /identity/v3/users/1356807fb3a14ede8cd8fc9eeeaab085 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:47.919541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:47.921934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:47.947730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf2603-0713-4088-a193-dce4de218932 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:48.026540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:48.027473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:48.027828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:48.028179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] PATH_INFO: `/v3/projects/f190c6d330234d8a8e463cedb2f41c8a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:48.031370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f190c6d330234d8a8e463cedb2f41c8a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:48.033634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:48.303825 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f190c6d330234d8a8e463cedb2f41c8a', 'request_id': 'req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:48.316787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f190c6d330234d8a8e463cedb2f41c8a', 'request_id': 'req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:48.339366 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f190c6d330234d8a8e463cedb2f41c8a', 'request_id': 'req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:48.516886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] The token cache is being invalidate because project f190c6d330234d8a8e463cedb2f41c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:48.516886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:48.518200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72477e1d-0097-4c5a-ab3a-3e69c0ee4ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:48.523549 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1313/2626] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:47 2022] DELETE /identity/v3/projects/f190c6d330234d8a8e463cedb2f41c8a => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:48.525580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eb8bd-4778-4b1d-8b09-69530ee4803e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:48.526326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eb8bd-4778-4b1d-8b09-69530ee4803e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:48.526621 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eb8bd-4778-4b1d-8b09-69530ee4803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:48.549365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-698eb8bd-4778-4b1d-8b09-69530ee4803e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:48.551279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-698eb8bd-4778-4b1d-8b09-69530ee4803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:48.634879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1314/2627] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:48.637595 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0bd4b-c541-4626-b3cd-f4c4204352f5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:48.637902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0bd4b-c541-4626-b3cd-f4c4204352f5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:48.638159 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0bd4b-c541-4626-b3cd-f4c4204352f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:48.668656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f5e0bd4b-c541-4626-b3cd-f4c4204352f5 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:48.671171 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f5e0bd4b-c541-4626-b3cd-f4c4204352f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:48.692136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1314/2628] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:48.698917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eb8bd-4778-4b1d-8b09-69530ee4803e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:48.713373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eb8bd-4778-4b1d-8b09-69530ee4803e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:48.719146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:48.723479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:48.723479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:48.723479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:48.723479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:48.723479 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:48.724154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:48.733627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:48.740464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1315/2629] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:48.745348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0bd4b-c541-4626-b3cd-f4c4204352f5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:48.756999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0bd4b-c541-4626-b3cd-f4c4204352f5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:48.762072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5000e51-58e6-4b93-8c41-925622f06008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:48.762692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5000e51-58e6-4b93-8c41-925622f06008 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:48.762971 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5000e51-58e6-4b93-8c41-925622f06008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:48.763242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5000e51-58e6-4b93-8c41-925622f06008 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:48.763902 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5000e51-58e6-4b93-8c41-925622f06008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:48.766371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5000e51-58e6-4b93-8c41-925622f06008 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:48.963062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:48.977561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1315/2630] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:48 2022] POST /identity/v3/projects => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:48.979467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:48.994379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1aeac-7fd2-4b7e-99d6-1f72812c6672 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:49.093298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a008df-f78b-4a71-9fac-113eb8171aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:49.093925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a008df-f78b-4a71-9fac-113eb8171aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:49.094210 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a008df-f78b-4a71-9fac-113eb8171aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:49.094510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a008df-f78b-4a71-9fac-113eb8171aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:49.095162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a008df-f78b-4a71-9fac-113eb8171aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:49.097819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a008df-f78b-4a71-9fac-113eb8171aa0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:49.241298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1316/2631] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:48 2022] POST /identity/v3/users => generated 282 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:49.245573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5000e51-58e6-4b93-8c41-925622f06008 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:49.258420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5000e51-58e6-4b93-8c41-925622f06008 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:49.265693 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99569348-667d-499d-8e15-2fec63e61b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:49.266400 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99569348-667d-499d-8e15-2fec63e61b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:49.266828 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99569348-667d-499d-8e15-2fec63e61b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:49.267108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99569348-667d-499d-8e15-2fec63e61b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:49.267781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99569348-667d-499d-8e15-2fec63e61b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:49.270088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99569348-667d-499d-8e15-2fec63e61b99 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:49.304283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1316/2632] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:49.307134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a008df-f78b-4a71-9fac-113eb8171aa0 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:49.318559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a008df-f78b-4a71-9fac-113eb8171aa0 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:49.323961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1956505-683a-4fdd-955e-a12bee715be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:49.325208 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1956505-683a-4fdd-955e-a12bee715be9 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:49.325671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1956505-683a-4fdd-955e-a12bee715be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:49.325981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1956505-683a-4fdd-955e-a12bee715be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:49.326685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1956505-683a-4fdd-955e-a12bee715be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:49.328405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1956505-683a-4fdd-955e-a12bee715be9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:49.341224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1317/2633] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:49.346394 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99569348-667d-499d-8e15-2fec63e61b99 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:49.357850 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99569348-667d-499d-8e15-2fec63e61b99 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:49.362639 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2557-c24b-4452-a7d7-6217aaed5cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:49.363367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2557-c24b-4452-a7d7-6217aaed5cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:49.363651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2557-c24b-4452-a7d7-6217aaed5cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:49.363931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b2557-c24b-4452-a7d7-6217aaed5cd0 admin admin] PATH_INFO: `/v3/projects/2c66eb49a2c945ea8f354b91645d77c7/users/43c4e079192a41cbb65179b994cda1db/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:49.380977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b2557-c24b-4452-a7d7-6217aaed5cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c66eb49a2c945ea8f354b91645d77c7, user_id=43c4e079192a41cbb65179b994cda1db, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:49.383787 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b2557-c24b-4452-a7d7-6217aaed5cd0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:49.506538 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1317/2634] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:49 2022] PUT /identity/v3/projects/2c66eb49a2c945ea8f354b91645d77c7/users/43c4e079192a41cbb65179b994cda1db/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:49.520008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3f44-41df-4cbf-8ae0-1f37383388db None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:49.520302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3f44-41df-4cbf-8ae0-1f37383388db None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:49.520580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d3f44-41df-4cbf-8ae0-1f37383388db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:49.551678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-915d3f44-41df-4cbf-8ae0-1f37383388db None None] MFA Rules not processed for user `43c4e079192a41cbb65179b994cda1db`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:49.552927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-915d3f44-41df-4cbf-8ae0-1f37383388db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:49.634374 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1318/2635] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:49.639651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2557-c24b-4452-a7d7-6217aaed5cd0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:49.727587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b2557-c24b-4452-a7d7-6217aaed5cd0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:49.732467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:49.733142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:49.733427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:49.733844 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:49.734353 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:49.736397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:49.858672 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1318/2636] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:49 2022] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:49.864460 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d3f44-41df-4cbf-8ae0-1f37383388db None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:49.882012 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d3f44-41df-4cbf-8ae0-1f37383388db None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:49.921982 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:49.927959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:49.998539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61027b5-e006-4963-92c8-065541c7c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:49.999350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61027b5-e006-4963-92c8-065541c7c307 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:49.999762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61027b5-e006-4963-92c8-065541c7c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:50.000144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61027b5-e006-4963-92c8-065541c7c307 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:50.000914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61027b5-e006-4963-92c8-065541c7c307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:50.003054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61027b5-e006-4963-92c8-065541c7c307 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:50.018795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:50.034116 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623aba1-0704-4b15-8bfc-4131917e6097 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:50.039011 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:50.039648 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:50.039935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:50.040215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:50.042140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:50.057110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:50.058895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:50.071216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1319/2637] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:50.134340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1319/2638] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:49 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:50.138281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:50.149115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121b2f5-33f8-432c-bf9a-8b1fbb18a392 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:50.154299 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bd8ed-750f-4c4f-86c5-16434d5a2f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:50.154931 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd8ed-750f-4c4f-86c5-16434d5a2f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:50.155227 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd8ed-750f-4c4f-86c5-16434d5a2f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:50.155507 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bd8ed-750f-4c4f-86c5-16434d5a2f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:50.156172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bd8ed-750f-4c4f-86c5-16434d5a2f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:50.157925 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bd8ed-750f-4c4f-86c5-16434d5a2f70 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:50.170040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1320/2639] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:50.174280 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61027b5-e006-4963-92c8-065541c7c307 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:50.187808 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61027b5-e006-4963-92c8-065541c7c307 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:50.193542 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286756a-f78b-41bf-99c0-f6b8850d9754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:50.194250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286756a-f78b-41bf-99c0-f6b8850d9754 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:50.194537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286756a-f78b-41bf-99c0-f6b8850d9754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:50.194991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286756a-f78b-41bf-99c0-f6b8850d9754 admin admin] PATH_INFO: `/v3/projects/141a11c9abae4c83924ae35a5aea8630/users/fb38f49933dd40eeb68341d9d65ded5f/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:50.226667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286756a-f78b-41bf-99c0-f6b8850d9754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141a11c9abae4c83924ae35a5aea8630, user_id=fb38f49933dd40eeb68341d9d65ded5f, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:50.226667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286756a-f78b-41bf-99c0-f6b8850d9754 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:50.322276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1320/2640] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:50 2022] PUT /identity/v3/projects/141a11c9abae4c83924ae35a5aea8630/users/fb38f49933dd40eeb68341d9d65ded5f/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:50.327502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bd8ed-750f-4c4f-86c5-16434d5a2f70 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:50.346805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bd8ed-750f-4c4f-86c5-16434d5a2f70 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:50.440284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:50.468090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf76279-45a2-4a16-8eff-044d53e648d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:50.469257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76279-45a2-4a16-8eff-044d53e648d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:50.469836 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76279-45a2-4a16-8eff-044d53e648d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:50.470533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76279-45a2-4a16-8eff-044d53e648d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:50.471698 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf76279-45a2-4a16-8eff-044d53e648d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:50.477098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf76279-45a2-4a16-8eff-044d53e648d4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:50.501635 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1321/2641] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:50.505822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286756a-f78b-41bf-99c0-f6b8850d9754 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:50.532356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286756a-f78b-41bf-99c0-f6b8850d9754 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:50.539587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:50.540284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:50.540612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:50.540884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] PATH_INFO: `/v3/projects/141a11c9abae4c83924ae35a5aea8630/users/fb38f49933dd40eeb68341d9d65ded5f/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:50.543065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141a11c9abae4c83924ae35a5aea8630, user_id=fb38f49933dd40eeb68341d9d65ded5f, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:50.546074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:50.560094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1321/2642] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:50 2022] PUT /identity/v3/projects/141a11c9abae4c83924ae35a5aea8630/users/fb38f49933dd40eeb68341d9d65ded5f/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:50.571537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21a09-eb11-4f5f-be66-caa8a18e7dc0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:50.572026 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21a09-eb11-4f5f-be66-caa8a18e7dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:50.572474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21a09-eb11-4f5f-be66-caa8a18e7dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:50.618200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c8e21a09-eb11-4f5f-be66-caa8a18e7dc0 None None] MFA Rules not processed for user `fb38f49933dd40eeb68341d9d65ded5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:50.619688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c8e21a09-eb11-4f5f-be66-caa8a18e7dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:50.730155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1322/2643] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:50.738289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:50.740265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:50.819813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c99ea-ed18-48af-a132-58076c4baeb9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:50.823734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:50.824419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:50.824656 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:50.825150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:50.837198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:50.838797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:50.850100 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1322/2644] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:51.092302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e21a09-eb11-4f5f-be66-caa8a18e7dc0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:51.102186 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e21a09-eb11-4f5f-be66-caa8a18e7dc0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:51.106071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b05ba-2bfe-46d0-aaed-25a8bad34e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:51.106678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b05ba-2bfe-46d0-aaed-25a8bad34e7c service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:51.106956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b05ba-2bfe-46d0-aaed-25a8bad34e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:51.107309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b05ba-2bfe-46d0-aaed-25a8bad34e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:51.185496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b05ba-2bfe-46d0-aaed-25a8bad34e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:51.186965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b05ba-2bfe-46d0-aaed-25a8bad34e7c service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:51.198959 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1323/2645] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:51.883159 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:51.886709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:52.000811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344885-c366-4400-844b-32d3b8085c4c service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:52.006206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:52.006961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:52.007247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:52.007523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] PATH_INFO: `/v3/users/41fdd3dbb8e84d4385792dbc7fa12dca` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:52.009551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41fdd3dbb8e84d4385792dbc7fa12dca)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:52.011863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:52.298294 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41fdd3dbb8e84d4385792dbc7fa12dca'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:52.300036 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41fdd3dbb8e84d4385792dbc7fa12dca'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:52.447109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41fdd3dbb8e84d4385792dbc7fa12dca'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:52.459188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:52.471713 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41fdd3dbb8e84d4385792dbc7fa12dca'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:52.472792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41fdd3dbb8e84d4385792dbc7fa12dca'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:52.493008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1323/2646] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:51 2022] DELETE /identity/v3/users/41fdd3dbb8e84d4385792dbc7fa12dca => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:52.496416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6e99-5c58-464a-bd1e-42f81e3a770d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:52.497123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6e99-5c58-464a-bd1e-42f81e3a770d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:52.497123 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e6e99-5c58-464a-bd1e-42f81e3a770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:52.518715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a79e6e99-5c58-464a-bd1e-42f81e3a770d None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:52.521486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a79e6e99-5c58-464a-bd1e-42f81e3a770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:52.604565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1324/2647] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:52.616189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:52.617710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:52.719854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca791a9-35d2-4be5-8389-c59ba3a04ef1 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:52.726123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc6ebd-cdd1-4cac-89db-8a1ccfd9ff54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:52.727225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc6ebd-cdd1-4cac-89db-8a1ccfd9ff54 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:52.727697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc6ebd-cdd1-4cac-89db-8a1ccfd9ff54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:52.728722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc6ebd-cdd1-4cac-89db-8a1ccfd9ff54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:52.742119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc6ebd-cdd1-4cac-89db-8a1ccfd9ff54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:52.744718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc6ebd-cdd1-4cac-89db-8a1ccfd9ff54 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:52.761961 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1324/2648] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:53.685488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e6e99-5c58-464a-bd1e-42f81e3a770d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:53.687046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a79e6e99-5c58-464a-bd1e-42f81e3a770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:53.695229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:53.700927 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e6e99-5c58-464a-bd1e-42f81e3a770d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:53.709178 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:53.710878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:53.712155 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:53.713211 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] PATH_INFO: `/v3/projects/97b45363955b451cb2a2c1c31e4e99c4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:53.716041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b45363955b451cb2a2c1c31e4e99c4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:53.721143 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:53.938509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b45363955b451cb2a2c1c31e4e99c4', 'request_id': 'req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:53.955018 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b45363955b451cb2a2c1c31e4e99c4', 'request_id': 'req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:53.968058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b45363955b451cb2a2c1c31e4e99c4', 'request_id': 'req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:54.157888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] The token cache is being invalidate because project 97b45363955b451cb2a2c1c31e4e99c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:54.158721 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:54.160670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:54.168983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1325/2649] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:53 2022] DELETE /identity/v3/projects/97b45363955b451cb2a2c1c31e4e99c4 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:54.170379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc6ebd-cdd1-4cac-89db-8a1ccfd9ff54 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:54.193457 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc6ebd-cdd1-4cac-89db-8a1ccfd9ff54 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:54.324299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:54.325252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:54.325678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:54.326160 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] PATH_INFO: `/v3/users/df7fe7047cf64eb8a1b4add816ddaec0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:54.327775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7fe7047cf64eb8a1b4add816ddaec0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:54.330431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:54.680495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7fe7047cf64eb8a1b4add816ddaec0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:54.681349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7fe7047cf64eb8a1b4add816ddaec0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:54.823521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7fe7047cf64eb8a1b4add816ddaec0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:54.843255 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7fe7047cf64eb8a1b4add816ddaec0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:54.844296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7fe7047cf64eb8a1b4add816ddaec0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:54.856115 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:54.864272 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1325/2650] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:54 2022] DELETE /identity/v3/users/df7fe7047cf64eb8a1b4add816ddaec0 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:55.447316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:55.449531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:55.468970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:55.470567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:55.496009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7b156-79eb-4ad1-9f71-b9fd18ce292f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:55.582383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5da7-a193-451e-bfe0-7fb6f6973d66 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:55.587566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:55.587790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:55.588296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:55.588416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:55.588575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:55.588764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:55.589080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] PATH_INFO: `/v3/projects/79442a0de04f48b297dc4defebf07e60` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:55.589337 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] PATH_INFO: `/v3/users/8b016f7487c546c1ab2cd0ff815099f7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:55.590273 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79442a0de04f48b297dc4defebf07e60)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:55.590689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b016f7487c546c1ab2cd0ff815099f7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:55.592498 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:55.592936 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:55.725076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79442a0de04f48b297dc4defebf07e60', 'request_id': 'req-152db964-80ba-4d24-a7c6-4edbace3b112'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.731426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79442a0de04f48b297dc4defebf07e60', 'request_id': 'req-152db964-80ba-4d24-a7c6-4edbace3b112'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.737056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79442a0de04f48b297dc4defebf07e60', 'request_id': 'req-152db964-80ba-4d24-a7c6-4edbace3b112'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.855156 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] The token cache is being invalidate because project 79442a0de04f48b297dc4defebf07e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:55.855674 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.858132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.863388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1326/2651] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:55 2022] DELETE /identity/v3/projects/79442a0de04f48b297dc4defebf07e60 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:55.866427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b016f7487c546c1ab2cd0ff815099f7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.868760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:55.875253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b016f7487c546c1ab2cd0ff815099f7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.875488 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:55.949072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db964-80ba-4d24-a7c6-4edbace3b112 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:55.954310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:55.954964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:55.955252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:55.955527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] PATH_INFO: `/v3/users/dfe059519398468a897d81bc172d8e8a` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:55.957305 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe059519398468a897d81bc172d8e8a)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:55.959558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:55.961136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b016f7487c546c1ab2cd0ff815099f7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.961891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b016f7487c546c1ab2cd0ff815099f7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:55.992469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b016f7487c546c1ab2cd0ff815099f7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.011929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1326/2652] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:55 2022] DELETE /identity/v3/users/8b016f7487c546c1ab2cd0ff815099f7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:56.253814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe059519398468a897d81bc172d8e8a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.254796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe059519398468a897d81bc172d8e8a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.307503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:56.307503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:56.314012 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:56.378978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe059519398468a897d81bc172d8e8a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.379218 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc82460-410a-4ae9-b1b4-e84834736ac5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:56.386968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:56.387632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:56.387969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:56.388317 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] PATH_INFO: `/v3/projects/f04b25a0fa2141699d19ba530198e4fc` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:56.389529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04b25a0fa2141699d19ba530198e4fc)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:56.391613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:56.396592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe059519398468a897d81bc172d8e8a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.397581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5a41d3bd-7392-4cfe-a00e-cb3e830514d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe059519398468a897d81bc172d8e8a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.412907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1327/2653] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:55 2022] DELETE /identity/v3/users/dfe059519398468a897d81bc172d8e8a => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:56.524452 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04b25a0fa2141699d19ba530198e4fc', 'request_id': 'req-50df2b03-4e61-4878-bbfa-ea099a955720'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.531659 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04b25a0fa2141699d19ba530198e4fc', 'request_id': 'req-50df2b03-4e61-4878-bbfa-ea099a955720'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.538094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04b25a0fa2141699d19ba530198e4fc', 'request_id': 'req-50df2b03-4e61-4878-bbfa-ea099a955720'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.682023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] The token cache is being invalidate because project f04b25a0fa2141699d19ba530198e4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:56.684554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.684554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-50df2b03-4e61-4878-bbfa-ea099a955720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:56.685833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1327/2654] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:56 2022] DELETE /identity/v3/projects/f04b25a0fa2141699d19ba530198e4fc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:56.691324 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11d96b-220f-4053-a588-50ac38f33a3f None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:56.691825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11d96b-220f-4053-a588-50ac38f33a3f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:56.691935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11d96b-220f-4053-a588-50ac38f33a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:56.715650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-3f11d96b-220f-4053-a588-50ac38f33a3f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:56.717243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3f11d96b-220f-4053-a588-50ac38f33a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:56.790923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1328/2655] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:56.798851 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b3e0c-c44d-41b2-a07d-57350f85c6c7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:56.799237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b3e0c-c44d-41b2-a07d-57350f85c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:56.799586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b3e0c-c44d-41b2-a07d-57350f85c6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:56.828158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b65b3e0c-c44d-41b2-a07d-57350f85c6c7 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:56.829411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b65b3e0c-c44d-41b2-a07d-57350f85c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:56.837788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1328/2656] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:56.842714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11d96b-220f-4053-a588-50ac38f33a3f None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:56.853862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11d96b-220f-4053-a588-50ac38f33a3f None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:56.859307 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:56.859926 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:56.860209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:56.860478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:56.861524 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:38:56.862178 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:56.866918 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:56.884740 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1329/2657] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:38:56.886586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b3e0c-c44d-41b2-a07d-57350f85c6c7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:56.897746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b3e0c-c44d-41b2-a07d-57350f85c6c7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:56.904060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4498b70-d912-4e16-98e7-5ca35ab9bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:56.904786 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4498b70-d912-4e16-98e7-5ca35ab9bf72 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:56.905158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4498b70-d912-4e16-98e7-5ca35ab9bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:56.905484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4498b70-d912-4e16-98e7-5ca35ab9bf72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:56.906416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4498b70-d912-4e16-98e7-5ca35ab9bf72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:56.908551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4498b70-d912-4e16-98e7-5ca35ab9bf72 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:56.956249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:56.958177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:56.973872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578dbc-e347-43bd-ac6f-10b49d64b7c4 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:56.980408 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:56.981298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:56.985647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:56.985647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] PATH_INFO: `/v3/projects/4b6b2a656b4245d5908751be059e3b72` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:56.993424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6b2a656b4245d5908751be059e3b72)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:56.995458 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:57.076869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1329/2658] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:56 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:57.087279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4498b70-d912-4e16-98e7-5ca35ab9bf72 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:57.128967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6b2a656b4245d5908751be059e3b72', 'request_id': 'req-52f7ce4c-7b1f-402c-ad62-4a35f923f412'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:57.136839 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6b2a656b4245d5908751be059e3b72', 'request_id': 'req-52f7ce4c-7b1f-402c-ad62-4a35f923f412'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:57.143251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6b2a656b4245d5908751be059e3b72', 'request_id': 'req-52f7ce4c-7b1f-402c-ad62-4a35f923f412'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:57.164826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4498b70-d912-4e16-98e7-5ca35ab9bf72 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:57.232154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f54bca-7146-4f63-9ce9-692d40dbb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:57.232762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f54bca-7146-4f63-9ce9-692d40dbb0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:57.233122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f54bca-7146-4f63-9ce9-692d40dbb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:57.233389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f54bca-7146-4f63-9ce9-692d40dbb0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:57.234030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f54bca-7146-4f63-9ce9-692d40dbb0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:57.236124 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f54bca-7146-4f63-9ce9-692d40dbb0c9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:57.282858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] The token cache is being invalidate because project 4b6b2a656b4245d5908751be059e3b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:38:57.283294 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:57.284971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:57.288828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1330/2659] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:38:56 2022] DELETE /identity/v3/projects/4b6b2a656b4245d5908751be059e3b72 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:57.372888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1330/2660] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:57 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:57.377701 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:57.379389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:57.395875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7ce4c-7b1f-402c-ad62-4a35f923f412 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:57.405120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a43fa-fef7-4bf6-9c51-96d5000bdddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:57.405120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a43fa-fef7-4bf6-9c51-96d5000bdddf admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:57.405120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a43fa-fef7-4bf6-9c51-96d5000bdddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:57.405120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a43fa-fef7-4bf6-9c51-96d5000bdddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:57.405615 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a43fa-fef7-4bf6-9c51-96d5000bdddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:57.407966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a43fa-fef7-4bf6-9c51-96d5000bdddf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:57.424528 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1331/2661] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:57.426554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f54bca-7146-4f63-9ce9-692d40dbb0c9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:57.439948 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f54bca-7146-4f63-9ce9-692d40dbb0c9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:57.447249 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fcf0d-a586-4016-8188-1f57a292c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:57.447986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fcf0d-a586-4016-8188-1f57a292c1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:57.448395 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fcf0d-a586-4016-8188-1f57a292c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:57.448740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fcf0d-a586-4016-8188-1f57a292c1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:57.450255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fcf0d-a586-4016-8188-1f57a292c1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:57.451324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fcf0d-a586-4016-8188-1f57a292c1f6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:57.464082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1331/2662] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:57.473676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a43fa-fef7-4bf6-9c51-96d5000bdddf admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:57.487337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a43fa-fef7-4bf6-9c51-96d5000bdddf admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:57.497795 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140c871-2ddf-48eb-af67-2e21d87a6840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:57.498805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c871-2ddf-48eb-af67-2e21d87a6840 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:57.499230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c871-2ddf-48eb-af67-2e21d87a6840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:57.499607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c871-2ddf-48eb-af67-2e21d87a6840 admin admin] PATH_INFO: `/v3/projects/354457f72d5a4170b8ff4d2521aefae2/users/78cbdcf642b04bab95b267bfea786665/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:57.522085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140c871-2ddf-48eb-af67-2e21d87a6840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354457f72d5a4170b8ff4d2521aefae2, user_id=78cbdcf642b04bab95b267bfea786665, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:57.525060 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140c871-2ddf-48eb-af67-2e21d87a6840 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:57.658358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1332/2663] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:57 2022] PUT /identity/v3/projects/354457f72d5a4170b8ff4d2521aefae2/users/78cbdcf642b04bab95b267bfea786665/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:38:57.669453 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7d63-3b6e-41c1-8051-df0ec0e8cb93 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:57.670033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7d63-3b6e-41c1-8051-df0ec0e8cb93 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:57.670033 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7d63-3b6e-41c1-8051-df0ec0e8cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:57.703879 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e56f7d63-3b6e-41c1-8051-df0ec0e8cb93 None None] MFA Rules not processed for user `78cbdcf642b04bab95b267bfea786665`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:57.708192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e56f7d63-3b6e-41c1-8051-df0ec0e8cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:57.785133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1332/2664] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:57.789827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140c871-2ddf-48eb-af67-2e21d87a6840 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:57.862461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140c871-2ddf-48eb-af67-2e21d87a6840 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:57.868190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ef71b-6270-4b88-89d5-610ba77c9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:57.868824 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ef71b-6270-4b88-89d5-610ba77c9aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:57.869147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ef71b-6270-4b88-89d5-610ba77c9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:57.869426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ef71b-6270-4b88-89d5-610ba77c9aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:57.870088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ef71b-6270-4b88-89d5-610ba77c9aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:57.872175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ef71b-6270-4b88-89d5-610ba77c9aa9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:58.004798 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1333/2665] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:38:57 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:38:58.019967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7d63-3b6e-41c1-8051-df0ec0e8cb93 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:58.023377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7d63-3b6e-41c1-8051-df0ec0e8cb93 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:58.118153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f60b2-b319-4bf1-a8d7-188fdd95869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:58.119008 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f60b2-b319-4bf1-a8d7-188fdd95869e admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:58.119376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f60b2-b319-4bf1-a8d7-188fdd95869e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:58.119749 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f60b2-b319-4bf1-a8d7-188fdd95869e admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:58.120542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f60b2-b319-4bf1-a8d7-188fdd95869e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:58.122715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f60b2-b319-4bf1-a8d7-188fdd95869e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:58.267715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1333/2666] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:38:58 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:38:58.272864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ef71b-6270-4b88-89d5-610ba77c9aa9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:58.284632 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ef71b-6270-4b88-89d5-610ba77c9aa9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:58.289539 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a645-3fad-49d6-9542-467d62c038a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:58.290167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a645-3fad-49d6-9542-467d62c038a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:58.293915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a645-3fad-49d6-9542-467d62c038a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:58.293915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a645-3fad-49d6-9542-467d62c038a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:58.293915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a645-3fad-49d6-9542-467d62c038a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:58.293915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a645-3fad-49d6-9542-467d62c038a9 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:58.306091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1334/2667] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:58.310590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f60b2-b319-4bf1-a8d7-188fdd95869e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:58.322484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f60b2-b319-4bf1-a8d7-188fdd95869e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:58.328139 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f447c1-fb05-4804-8573-7166d53f6449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:58.329178 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f447c1-fb05-4804-8573-7166d53f6449 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:58.329459 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f447c1-fb05-4804-8573-7166d53f6449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:58.329773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f447c1-fb05-4804-8573-7166d53f6449 admin admin] PATH_INFO: `/v3/projects/a4286bf77d594b1ab938bffd8af3c9c6/users/2770932de4b0427d9fc678d01403fcf8/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:58.352131 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f447c1-fb05-4804-8573-7166d53f6449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4286bf77d594b1ab938bffd8af3c9c6, user_id=2770932de4b0427d9fc678d01403fcf8, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:58.354839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f447c1-fb05-4804-8573-7166d53f6449 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:58.480782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1334/2668] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:58 2022] PUT /identity/v3/projects/a4286bf77d594b1ab938bffd8af3c9c6/users/2770932de4b0427d9fc678d01403fcf8/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:58.486921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a645-3fad-49d6-9542-467d62c038a9 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:58.498119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a645-3fad-49d6-9542-467d62c038a9 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:58.565587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea714a1-8d7a-4a7d-8b1a-c08c6ebb4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:58.566741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea714a1-8d7a-4a7d-8b1a-c08c6ebb4e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:58.567088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea714a1-8d7a-4a7d-8b1a-c08c6ebb4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:58.567412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea714a1-8d7a-4a7d-8b1a-c08c6ebb4e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:58.568482 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea714a1-8d7a-4a7d-8b1a-c08c6ebb4e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:58.571567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea714a1-8d7a-4a7d-8b1a-c08c6ebb4e91 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:58.584383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1335/2669] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:38:58.595569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f447c1-fb05-4804-8573-7166d53f6449 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:58.607052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f447c1-fb05-4804-8573-7166d53f6449 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:58.614599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:58.615277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:58.615557 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:58.615826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] PATH_INFO: `/v3/projects/a4286bf77d594b1ab938bffd8af3c9c6/users/2770932de4b0427d9fc678d01403fcf8/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:58.617853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4286bf77d594b1ab938bffd8af3c9c6, user_id=2770932de4b0427d9fc678d01403fcf8, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:58.620657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:58.632292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1335/2670] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:38:58 2022] PUT /identity/v3/projects/a4286bf77d594b1ab938bffd8af3c9c6/users/2770932de4b0427d9fc678d01403fcf8/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:58.645086 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda749-3936-4c83-a9f9-4659c0616420 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:58.645435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda749-3936-4c83-a9f9-4659c0616420 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:58.645771 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eda749-3936-4c83-a9f9-4659c0616420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:58.675854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b5eda749-3936-4c83-a9f9-4659c0616420 None None] MFA Rules not processed for user `2770932de4b0427d9fc678d01403fcf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:58.677128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b5eda749-3936-4c83-a9f9-4659c0616420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:58.759072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1336/2671] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:58.771268 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:58.773774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:58.778835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:38:58.858679 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4161f6-35bd-4083-a3e1-8e691e2fbd94 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:58.866224 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:58.867244 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:58.867244 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:58.867553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:58.877916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:58.879440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:58.890160 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1336/2672] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:59.274099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eda749-3936-4c83-a9f9-4659c0616420 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:59.277362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:59.278736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:59.284371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eda749-3936-4c83-a9f9-4659c0616420 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:59.288400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee5401-6f1c-43be-a8d0-637daa99d088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:59.289056 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5401-6f1c-43be-a8d0-637daa99d088 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:59.289341 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5401-6f1c-43be-a8d0-637daa99d088 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:59.289617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5401-6f1c-43be-a8d0-637daa99d088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:59.349796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8e966-28bd-4d26-bf2d-93bc1df20c5a service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:59.351194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee5401-6f1c-43be-a8d0-637daa99d088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:59.353668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee5401-6f1c-43be-a8d0-637daa99d088 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:59.357067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:59.357067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:59.357067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:59.357067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] PATH_INFO: `/v3/users/43c4e079192a41cbb65179b994cda1db` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:59.357412 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c4e079192a41cbb65179b994cda1db)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:59.358723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:59.363113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1337/2673] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:38:59.557398 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c4e079192a41cbb65179b994cda1db'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:59.558057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c4e079192a41cbb65179b994cda1db'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:59.674369 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c4e079192a41cbb65179b994cda1db'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:59.675499 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c4e079192a41cbb65179b994cda1db'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:59.688717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c4e079192a41cbb65179b994cda1db'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:38:59.701653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1337/2674] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:38:59 2022] DELETE /identity/v3/users/43c4e079192a41cbb65179b994cda1db => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:38:59.706429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118baa4e-28db-423c-b44b-e7fe92d2ea59 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:59.706770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118baa4e-28db-423c-b44b-e7fe92d2ea59 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:59.707052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118baa4e-28db-423c-b44b-e7fe92d2ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:59.726354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-118baa4e-28db-423c-b44b-e7fe92d2ea59 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:38:59.727577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-118baa4e-28db-423c-b44b-e7fe92d2ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:59.798344 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1338/2675] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:38:59.809694 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:38:59.811607 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:38:59.886107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89f252-90b0-4951-a596-3dac6f97f61e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:38:59.892500 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04aad-1501-41af-aeb1-f645b120d64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:38:59.893600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04aad-1501-41af-aeb1-f645b120d64f service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:38:59.894775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04aad-1501-41af-aeb1-f645b120d64f service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:38:59.894775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04aad-1501-41af-aeb1-f645b120d64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:38:59.911295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04aad-1501-41af-aeb1-f645b120d64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:38:59.912824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04aad-1501-41af-aeb1-f645b120d64f service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:38:59.923908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1338/2676] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:00.320605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:00.470736 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118baa4e-28db-423c-b44b-e7fe92d2ea59 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:00.472939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-118baa4e-28db-423c-b44b-e7fe92d2ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:00.486892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118baa4e-28db-423c-b44b-e7fe92d2ea59 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:00.493315 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:00.493974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:00.494263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:00.494543 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] PATH_INFO: `/v3/projects/2c66eb49a2c945ea8f354b91645d77c7` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:00.495726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c66eb49a2c945ea8f354b91645d77c7)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:00.497796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:00.654937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c66eb49a2c945ea8f354b91645d77c7', 'request_id': 'req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:00.661501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c66eb49a2c945ea8f354b91645d77c7', 'request_id': 'req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:00.667414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c66eb49a2c945ea8f354b91645d77c7', 'request_id': 'req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:00.805726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] The token cache is being invalidate because project 2c66eb49a2c945ea8f354b91645d77c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:00.805936 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:00.806590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:00.808117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1339/2677] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:00 2022] DELETE /identity/v3/projects/2c66eb49a2c945ea8f354b91645d77c7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:00.812367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04aad-1501-41af-aeb1-f645b120d64f service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:00.822646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04aad-1501-41af-aeb1-f645b120d64f service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:00.881852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:00.882489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:00.882769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:00.883045 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] PATH_INFO: `/v3/users/fb38f49933dd40eeb68341d9d65ded5f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:00.884193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb38f49933dd40eeb68341d9d65ded5f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:00.886163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:01.141265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb38f49933dd40eeb68341d9d65ded5f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:01.142013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb38f49933dd40eeb68341d9d65ded5f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:01.268378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb38f49933dd40eeb68341d9d65ded5f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:01.269260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb38f49933dd40eeb68341d9d65ded5f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:01.282281 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fefa0f15-01b3-4b37-bb91-64669eb654af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb38f49933dd40eeb68341d9d65ded5f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:01.294946 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1339/2678] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:00 2022] DELETE /identity/v3/users/fb38f49933dd40eeb68341d9d65ded5f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:01.676219 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:01.775478 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:01.777797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:01.792347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc565e-8f56-47f9-8e92-4aa36b8aebf1 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:01.883340 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:01.884068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:01.884414 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:01.884759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] PATH_INFO: `/v3/projects/141a11c9abae4c83924ae35a5aea8630` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:01.891165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141a11c9abae4c83924ae35a5aea8630)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:01.893242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:02.099068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141a11c9abae4c83924ae35a5aea8630', 'request_id': 'req-ce48eb94-96c7-4df0-932e-b84653200585'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:02.105643 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141a11c9abae4c83924ae35a5aea8630', 'request_id': 'req-ce48eb94-96c7-4df0-932e-b84653200585'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:02.111702 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141a11c9abae4c83924ae35a5aea8630', 'request_id': 'req-ce48eb94-96c7-4df0-932e-b84653200585'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:02.217433 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c1eb5-344f-4b0a-950d-5ae3f017e7c2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.217942 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c1eb5-344f-4b0a-950d-5ae3f017e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.218075 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c1eb5-344f-4b0a-950d-5ae3f017e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.233801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] The token cache is being invalidate because project 141a11c9abae4c83924ae35a5aea8630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:02.234106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:02.234787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ce48eb94-96c7-4df0-932e-b84653200585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:02.236325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1340/2679] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:01 2022] DELETE /identity/v3/projects/141a11c9abae4c83924ae35a5aea8630 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:02.241440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8193a3-5bb9-4ecc-9cca-80ad3f025800 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.241820 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8193a3-5bb9-4ecc-9cca-80ad3f025800 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.242154 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8193a3-5bb9-4ecc-9cca-80ad3f025800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.246689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-207c1eb5-344f-4b0a-950d-5ae3f017e7c2 None None] MFA Rules not processed for user `c1de610a786549a7b4d16fabc35c37b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:02.248110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-207c1eb5-344f-4b0a-950d-5ae3f017e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:02.266534 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-fa8193a3-5bb9-4ecc-9cca-80ad3f025800 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:02.268020 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-fa8193a3-5bb9-4ecc-9cca-80ad3f025800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:02.323068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1340/2680] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:02.334206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1341/2681] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:02.350943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed25b-a625-45f1-bbbd-2e124c93e811 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.351436 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed25b-a625-45f1-bbbd-2e124c93e811 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.351843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed25b-a625-45f1-bbbd-2e124c93e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.371972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6f2ed25b-a625-45f1-bbbd-2e124c93e811 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:02.373282 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6f2ed25b-a625-45f1-bbbd-2e124c93e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:02.382622 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1341/2682] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:02.386739 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8193a3-5bb9-4ecc-9cca-80ad3f025800 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:02.397284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8193a3-5bb9-4ecc-9cca-80ad3f025800 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:02.402042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:02.402655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.402934 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.403210 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.403879 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:39:02.404190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:02.405917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:02.418645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1342/2683] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:39:02.428577 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ed25b-a625-45f1-bbbd-2e124c93e811 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:02.442759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ed25b-a625-45f1-bbbd-2e124c93e811 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:02.447655 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98d1eb-ad75-4686-8b61-bd1f65d68a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:02.448283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d1eb-ad75-4686-8b61-bd1f65d68a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.448559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d1eb-ad75-4686-8b61-bd1f65d68a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.448840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98d1eb-ad75-4686-8b61-bd1f65d68a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.449525 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98d1eb-ad75-4686-8b61-bd1f65d68a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:02.451440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98d1eb-ad75-4686-8b61-bd1f65d68a87 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:02.536238 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1342/2684] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:02 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:02.537804 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:02.553429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19698ec5-6a38-4b96-84b9-f61ed04a6bd4 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:02.623855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2c0ec-2815-411d-9ce3-a056dbe98663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:02.624493 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2c0ec-2815-411d-9ce3-a056dbe98663 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.624767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2c0ec-2815-411d-9ce3-a056dbe98663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.625743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2c0ec-2815-411d-9ce3-a056dbe98663 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.626437 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2c0ec-2815-411d-9ce3-a056dbe98663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:02.628430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2c0ec-2815-411d-9ce3-a056dbe98663 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:02.725121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1343/2685] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:02 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:02.732082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:02.738339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98d1eb-ad75-4686-8b61-bd1f65d68a87 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:02.749933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98d1eb-ad75-4686-8b61-bd1f65d68a87 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:02.756583 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f7f68-e96b-4250-a8f0-e458f819277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:02.757246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f7f68-e96b-4250-a8f0-e458f819277b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.757531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f7f68-e96b-4250-a8f0-e458f819277b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.757808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f7f68-e96b-4250-a8f0-e458f819277b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.758797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f7f68-e96b-4250-a8f0-e458f819277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:02.760428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f7f68-e96b-4250-a8f0-e458f819277b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:02.771192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1343/2686] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:02.775072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2c0ec-2815-411d-9ce3-a056dbe98663 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:02.786333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2c0ec-2815-411d-9ce3-a056dbe98663 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:02.792217 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0e61-54db-4285-8afb-6d1185393a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:02.792841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0e61-54db-4285-8afb-6d1185393a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.793163 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0e61-54db-4285-8afb-6d1185393a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.793438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0e61-54db-4285-8afb-6d1185393a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.797259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0e61-54db-4285-8afb-6d1185393a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:02.797259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0e61-54db-4285-8afb-6d1185393a10 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:02.811572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1344/2687] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:02.812866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f7f68-e96b-4250-a8f0-e458f819277b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:02.823580 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f7f68-e96b-4250-a8f0-e458f819277b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:02.828619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c432a7-5e56-4522-a64c-17e67571a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:02.829589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c432a7-5e56-4522-a64c-17e67571a7da admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:02.829994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c432a7-5e56-4522-a64c-17e67571a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:02.830368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c432a7-5e56-4522-a64c-17e67571a7da admin admin] PATH_INFO: `/v3/projects/594da9881b6640dd82b2362ec4d4524d/users/3c951c9abed84f988f93a89a85a3393f/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:02.849021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c432a7-5e56-4522-a64c-17e67571a7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=594da9881b6640dd82b2362ec4d4524d, user_id=3c951c9abed84f988f93a89a85a3393f, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:02.852283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c432a7-5e56-4522-a64c-17e67571a7da admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:03.050818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1344/2688] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:02 2022] PUT /identity/v3/projects/594da9881b6640dd82b2362ec4d4524d/users/3c951c9abed84f988f93a89a85a3393f/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:03.057855 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a60c-31d6-4595-87d6-0e37bcf8e944 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:03.057998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a60c-31d6-4595-87d6-0e37bcf8e944 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:03.058308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012a60c-31d6-4595-87d6-0e37bcf8e944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:03.091434 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c012a60c-31d6-4595-87d6-0e37bcf8e944 None None] MFA Rules not processed for user `3c951c9abed84f988f93a89a85a3393f`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:03.091646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c012a60c-31d6-4595-87d6-0e37bcf8e944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:03.176272 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1345/2689] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:03.181185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c432a7-5e56-4522-a64c-17e67571a7da admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:03.255674 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c432a7-5e56-4522-a64c-17e67571a7da admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:03.262202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f3cac-0b44-4261-945b-62e4b862c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:03.262830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f3cac-0b44-4261-945b-62e4b862c82f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:03.263111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f3cac-0b44-4261-945b-62e4b862c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:03.263388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f3cac-0b44-4261-945b-62e4b862c82f admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:03.264040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f3cac-0b44-4261-945b-62e4b862c82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:03.266014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f3cac-0b44-4261-945b-62e4b862c82f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:03.390539 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1345/2690] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:03 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:03.395823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012a60c-31d6-4595-87d6-0e37bcf8e944 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:03.407963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012a60c-31d6-4595-87d6-0e37bcf8e944 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:03.474949 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ca67d-ea49-47d3-9105-aef50f945d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:03.475577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ca67d-ea49-47d3-9105-aef50f945d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:03.475865 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ca67d-ea49-47d3-9105-aef50f945d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:03.476136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ca67d-ea49-47d3-9105-aef50f945d10 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:03.476796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ca67d-ea49-47d3-9105-aef50f945d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:03.478852 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ca67d-ea49-47d3-9105-aef50f945d10 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:03.624186 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1346/2691] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:03 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:03.628401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f3cac-0b44-4261-945b-62e4b862c82f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:03.640585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f3cac-0b44-4261-945b-62e4b862c82f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:03.646257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5b8a-d376-4a95-a65c-0b2a5c60874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:03.646863 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5b8a-d376-4a95-a65c-0b2a5c60874b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:03.647140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5b8a-d376-4a95-a65c-0b2a5c60874b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:03.647401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a5b8a-d376-4a95-a65c-0b2a5c60874b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:03.648251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5b8a-d376-4a95-a65c-0b2a5c60874b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:03.649854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a5b8a-d376-4a95-a65c-0b2a5c60874b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:03.673256 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1346/2692] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:03.677858 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ca67d-ea49-47d3-9105-aef50f945d10 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:03.691029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ca67d-ea49-47d3-9105-aef50f945d10 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:03.697237 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6666b-2cb6-465b-acf1-043a09030bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:03.698082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6666b-2cb6-465b-acf1-043a09030bda admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:03.698369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6666b-2cb6-465b-acf1-043a09030bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:03.698674 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6666b-2cb6-465b-acf1-043a09030bda admin admin] PATH_INFO: `/v3/projects/90bf8219672946e498636627d09b65e9/users/41076f4c0f9d47e690cf0bc86edddcef/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:03.716286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6666b-2cb6-465b-acf1-043a09030bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bf8219672946e498636627d09b65e9, user_id=41076f4c0f9d47e690cf0bc86edddcef, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:03.719046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6666b-2cb6-465b-acf1-043a09030bda admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:03.849090 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1347/2693] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:03 2022] PUT /identity/v3/projects/90bf8219672946e498636627d09b65e9/users/41076f4c0f9d47e690cf0bc86edddcef/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:03.861411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5b8a-d376-4a95-a65c-0b2a5c60874b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:03.874589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a5b8a-d376-4a95-a65c-0b2a5c60874b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:03.948613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a319f40-5721-4828-9cc4-9ece421c12b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:03.949275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a319f40-5721-4828-9cc4-9ece421c12b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:03.949552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a319f40-5721-4828-9cc4-9ece421c12b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:03.949827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a319f40-5721-4828-9cc4-9ece421c12b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:03.950486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a319f40-5721-4828-9cc4-9ece421c12b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:03.952179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a319f40-5721-4828-9cc4-9ece421c12b6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:03.962908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1347/2694] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:03.967249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6666b-2cb6-465b-acf1-043a09030bda admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:03.978127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6666b-2cb6-465b-acf1-043a09030bda admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:03.982849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:03.983510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:03.983796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:03.984074 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] PATH_INFO: `/v3/projects/90bf8219672946e498636627d09b65e9/users/41076f4c0f9d47e690cf0bc86edddcef/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:03.986077 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bf8219672946e498636627d09b65e9, user_id=41076f4c0f9d47e690cf0bc86edddcef, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:03.989387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:04.047129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1348/2695] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:03 2022] PUT /identity/v3/projects/90bf8219672946e498636627d09b65e9/users/41076f4c0f9d47e690cf0bc86edddcef/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:04.058598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552e547-bb5d-4c5b-a49f-227d5dd6e453 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:04.058916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552e547-bb5d-4c5b-a49f-227d5dd6e453 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:04.059190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552e547-bb5d-4c5b-a49f-227d5dd6e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:04.090040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7552e547-bb5d-4c5b-a49f-227d5dd6e453 None None] MFA Rules not processed for user `41076f4c0f9d47e690cf0bc86edddcef`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:04.091232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7552e547-bb5d-4c5b-a49f-227d5dd6e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:04.168042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1348/2696] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:04.179639 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:04.181688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:04.251370 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb547cc-31b7-420a-825d-d7338ed88c93 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:04.257021 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439967-da67-49d4-80fc-f24f374d2242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:04.263572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439967-da67-49d4-80fc-f24f374d2242 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:04.263572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439967-da67-49d4-80fc-f24f374d2242 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:04.263572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439967-da67-49d4-80fc-f24f374d2242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:04.269913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439967-da67-49d4-80fc-f24f374d2242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:04.271385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439967-da67-49d4-80fc-f24f374d2242 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:04.282121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1349/2697] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:04.475304 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:04.663615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:04.861688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552e547-bb5d-4c5b-a49f-227d5dd6e453 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:04.935271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552e547-bb5d-4c5b-a49f-227d5dd6e453 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:04.940237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:04.940910 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:04.949996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:04.949996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] PATH_INFO: `/v3/users/3c951c9abed84f988f93a89a85a3393f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:04.949996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c951c9abed84f988f93a89a85a3393f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:04.949996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:05.214469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c951c9abed84f988f93a89a85a3393f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:05.221633 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c951c9abed84f988f93a89a85a3393f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:05.308101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c951c9abed84f988f93a89a85a3393f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:05.312427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c951c9abed84f988f93a89a85a3393f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:05.322284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c951c9abed84f988f93a89a85a3393f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:05.335426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1349/2698] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:04 2022] DELETE /identity/v3/users/3c951c9abed84f988f93a89a85a3393f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:05.339994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826efeb-cfc1-436a-8bf8-a181be4a031b None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:05.340497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826efeb-cfc1-436a-8bf8-a181be4a031b None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:05.341088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826efeb-cfc1-436a-8bf8-a181be4a031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:05.360928 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-a826efeb-cfc1-436a-8bf8-a181be4a031b None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:05.362069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a826efeb-cfc1-436a-8bf8-a181be4a031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:05.430497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1350/2699] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:05.441591 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:05.443546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:05.479781 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:05.506558 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb2bc6-2051-4433-90db-c9350a43a57f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:05.512550 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460000f-d6f4-424f-bcfe-b7b64af5d1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:05.519504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460000f-d6f4-424f-bcfe-b7b64af5d1cc service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:05.519504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460000f-d6f4-424f-bcfe-b7b64af5d1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:05.519504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460000f-d6f4-424f-bcfe-b7b64af5d1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:05.525410 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460000f-d6f4-424f-bcfe-b7b64af5d1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:05.526867 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460000f-d6f4-424f-bcfe-b7b64af5d1cc service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:05.546402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1350/2700] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:05.840236 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:06.045575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826efeb-cfc1-436a-8bf8-a181be4a031b None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:06.048525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a826efeb-cfc1-436a-8bf8-a181be4a031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:06.068680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826efeb-cfc1-436a-8bf8-a181be4a031b None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:06.080596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:06.081337 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:06.081630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:06.081907 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] PATH_INFO: `/v3/projects/594da9881b6640dd82b2362ec4d4524d` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:06.083203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=594da9881b6640dd82b2362ec4d4524d)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:06.085945 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:06.233917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594da9881b6640dd82b2362ec4d4524d', 'request_id': 'req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.240521 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594da9881b6640dd82b2362ec4d4524d', 'request_id': 'req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.246224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594da9881b6640dd82b2362ec4d4524d', 'request_id': 'req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.309682 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:06.317239 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] The token cache is being invalidate because project 594da9881b6640dd82b2362ec4d4524d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:06.318834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.318834 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.319913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1351/2701] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:06 2022] DELETE /identity/v3/projects/594da9881b6640dd82b2362ec4d4524d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:06.323943 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460000f-d6f4-424f-bcfe-b7b64af5d1cc service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:06.334663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460000f-d6f4-424f-bcfe-b7b64af5d1cc service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:06.399118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:06.399759 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:06.400049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:06.400326 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] PATH_INFO: `/v3/users/41076f4c0f9d47e690cf0bc86edddcef` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:06.401641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41076f4c0f9d47e690cf0bc86edddcef)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:06.403587 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:06.653095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41076f4c0f9d47e690cf0bc86edddcef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.653807 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41076f4c0f9d47e690cf0bc86edddcef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.772741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:06.773487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41076f4c0f9d47e690cf0bc86edddcef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.774197 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41076f4c0f9d47e690cf0bc86edddcef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.787340 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-17693daf-b575-41ac-b385-3bcd66627033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41076f4c0f9d47e690cf0bc86edddcef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:06.801091 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1351/2702] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:06 2022] DELETE /identity/v3/users/41076f4c0f9d47e690cf0bc86edddcef => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:07.154623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:07.323789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:07.326394 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:07.361151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:07.421680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31587d51-7251-44d2-bd0b-b3bbcb52ff0c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:07.481144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:07.481785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:07.483980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:07.483980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] PATH_INFO: `/v3/projects/90bf8219672946e498636627d09b65e9` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:07.483980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bf8219672946e498636627d09b65e9)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:07.485925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:07.624046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bf8219672946e498636627d09b65e9', 'request_id': 'req-2224599e-7439-4f16-850e-ee2c6c671b59'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:07.630751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bf8219672946e498636627d09b65e9', 'request_id': 'req-2224599e-7439-4f16-850e-ee2c6c671b59'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:07.638046 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bf8219672946e498636627d09b65e9', 'request_id': 'req-2224599e-7439-4f16-850e-ee2c6c671b59'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:07.716698 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] The token cache is being invalidate because project 90bf8219672946e498636627d09b65e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:07.717117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:07.718647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2224599e-7439-4f16-850e-ee2c6c671b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:07.719306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1352/2703] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:07 2022] DELETE /identity/v3/projects/90bf8219672946e498636627d09b65e9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:07.724975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc753-bf12-4a6b-a2f9-5397539a0f1e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:07.725298 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc753-bf12-4a6b-a2f9-5397539a0f1e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:07.725574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc753-bf12-4a6b-a2f9-5397539a0f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:07.791575 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1b9fc753-bf12-4a6b-a2f9-5397539a0f1e None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:07.792853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1b9fc753-bf12-4a6b-a2f9-5397539a0f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:07.846412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:07.861114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1352/2704] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:07.870581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff339d-87a4-44ba-95be-a73ea1705a94 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:07.871151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff339d-87a4-44ba-95be-a73ea1705a94 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:07.871625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff339d-87a4-44ba-95be-a73ea1705a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:07.893182 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-3eff339d-87a4-44ba-95be-a73ea1705a94 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:07.894397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3eff339d-87a4-44ba-95be-a73ea1705a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:07.903426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1353/2705] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:07.907805 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc753-bf12-4a6b-a2f9-5397539a0f1e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:07.918835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc753-bf12-4a6b-a2f9-5397539a0f1e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:07.923696 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:07.924358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:07.924641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:07.924913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:07.925653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:39:07.926107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:07.927748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:07.942428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1353/2706] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:39:07.946896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff339d-87a4-44ba-95be-a73ea1705a94 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:07.958354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff339d-87a4-44ba-95be-a73ea1705a94 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:07.962955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7614-0721-4a38-9bb9-277367f1c618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:07.963575 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7614-0721-4a38-9bb9-277367f1c618 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:07.963861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7614-0721-4a38-9bb9-277367f1c618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:07.964140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa7614-0721-4a38-9bb9-277367f1c618 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:07.964806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa7614-0721-4a38-9bb9-277367f1c618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:07.967220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa7614-0721-4a38-9bb9-277367f1c618 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:08.140456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1354/2707] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:07 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:08.147626 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:08.163778 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a19e19-f8c6-46d6-a93b-db7db22fddae admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:08.228335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b834263-c878-4021-8e08-75ad521b9732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:08.228989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b834263-c878-4021-8e08-75ad521b9732 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:08.229263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b834263-c878-4021-8e08-75ad521b9732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:08.229748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b834263-c878-4021-8e08-75ad521b9732 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:08.230367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b834263-c878-4021-8e08-75ad521b9732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:08.232334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b834263-c878-4021-8e08-75ad521b9732 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:08.349283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1354/2708] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:08 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:08.353815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7614-0721-4a38-9bb9-277367f1c618 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:08.365953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa7614-0721-4a38-9bb9-277367f1c618 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:08.372366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c9a0d-3a9c-466d-b7a1-0fce14fd9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:08.373099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c9a0d-3a9c-466d-b7a1-0fce14fd9ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:08.373386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c9a0d-3a9c-466d-b7a1-0fce14fd9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:08.373668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c9a0d-3a9c-466d-b7a1-0fce14fd9ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:08.374352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c9a0d-3a9c-466d-b7a1-0fce14fd9ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:08.377316 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c9a0d-3a9c-466d-b7a1-0fce14fd9ad5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:08.388708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1355/2709] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:08.395920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b834263-c878-4021-8e08-75ad521b9732 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:08.409068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b834263-c878-4021-8e08-75ad521b9732 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:08.415444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3834-a549-49cf-b7d8-d67a71334719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:08.417215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3834-a549-49cf-b7d8-d67a71334719 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:08.417215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3834-a549-49cf-b7d8-d67a71334719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:08.417215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3834-a549-49cf-b7d8-d67a71334719 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:08.423913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3834-a549-49cf-b7d8-d67a71334719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:08.423913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3834-a549-49cf-b7d8-d67a71334719 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:08.434377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1355/2710] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:08.445565 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c9a0d-3a9c-466d-b7a1-0fce14fd9ad5 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:08.461473 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c9a0d-3a9c-466d-b7a1-0fce14fd9ad5 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:08.468597 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7231c0-c968-40d5-837d-8266f5e5f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:08.469050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7231c0-c968-40d5-837d-8266f5e5f370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:08.469439 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7231c0-c968-40d5-837d-8266f5e5f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:08.469925 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7231c0-c968-40d5-837d-8266f5e5f370 admin admin] PATH_INFO: `/v3/projects/3f06a273d92d4b3bb49d5d48b552c79b/users/6375c8a11117461f93b6aff4a8018bfe/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:08.495147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7231c0-c968-40d5-837d-8266f5e5f370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f06a273d92d4b3bb49d5d48b552c79b, user_id=6375c8a11117461f93b6aff4a8018bfe, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:08.500455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7231c0-c968-40d5-837d-8266f5e5f370 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:08.503201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:08.561223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1356/2711] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:08 2022] PUT /identity/v3/projects/3f06a273d92d4b3bb49d5d48b552c79b/users/6375c8a11117461f93b6aff4a8018bfe/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:08.579968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8393c-84ce-4806-9d04-4e1628a23fe1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:08.580241 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8393c-84ce-4806-9d04-4e1628a23fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:08.580530 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8393c-84ce-4806-9d04-4e1628a23fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:08.636029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-98d8393c-84ce-4806-9d04-4e1628a23fe1 None None] MFA Rules not processed for user `6375c8a11117461f93b6aff4a8018bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:08.637332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-98d8393c-84ce-4806-9d04-4e1628a23fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:08.712866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1356/2712] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:08.717556 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7231c0-c968-40d5-837d-8266f5e5f370 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:08.783030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8393c-84ce-4806-9d04-4e1628a23fe1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:08.784444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-98d8393c-84ce-4806-9d04-4e1628a23fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:08.794640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7231c0-c968-40d5-837d-8266f5e5f370 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:08.798266 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8393c-84ce-4806-9d04-4e1628a23fe1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:08.799466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514ad7-3e0a-4fdb-950c-e7967c6299da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:08.800081 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514ad7-3e0a-4fdb-950c-e7967c6299da admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:08.800361 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514ad7-3e0a-4fdb-950c-e7967c6299da admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:08.800630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514ad7-3e0a-4fdb-950c-e7967c6299da admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:08.801500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2514ad7-3e0a-4fdb-950c-e7967c6299da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:08.803402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:08.803585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2514ad7-3e0a-4fdb-950c-e7967c6299da admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:08.804090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:08.804368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:08.804641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] PATH_INFO: `/v3/users/78cbdcf642b04bab95b267bfea786665` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:08.806095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78cbdcf642b04bab95b267bfea786665)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:08.808001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:08.834814 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:08.900831 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1357/2713] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:08 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:08.905213 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514ad7-3e0a-4fdb-950c-e7967c6299da admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:08.989906 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514ad7-3e0a-4fdb-950c-e7967c6299da admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:08.995455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:08.996091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:08.996387 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:08.996683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:08.997412 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:08.999559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:09.134284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78cbdcf642b04bab95b267bfea786665'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:09.134855 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78cbdcf642b04bab95b267bfea786665'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:09.165393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1358/2714] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:08 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:09.169428 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:09.171841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:09.183746 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48710ed-79dd-428a-bfa8-37710bbb4a0f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:09.188373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaae4d-d982-429a-a48e-7bfbd9619530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:09.188978 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaae4d-d982-429a-a48e-7bfbd9619530 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:09.189321 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaae4d-d982-429a-a48e-7bfbd9619530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:09.189592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdaae4d-d982-429a-a48e-7bfbd9619530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:09.190229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaae4d-d982-429a-a48e-7bfbd9619530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:09.192871 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdaae4d-d982-429a-a48e-7bfbd9619530 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:09.209276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1359/2715] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:39:09.213137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaae4d-d982-429a-a48e-7bfbd9619530 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:09.222956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdaae4d-d982-429a-a48e-7bfbd9619530 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:09.227550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e362-c04a-4139-b7a7-59ae9a677739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:09.235123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e362-c04a-4139-b7a7-59ae9a677739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:09.235123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e362-c04a-4139-b7a7-59ae9a677739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:09.235123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e362-c04a-4139-b7a7-59ae9a677739 admin admin] PATH_INFO: `/v3/projects/0d1bd8618b3e4053958e7c5bb456f8f0/users/10d1b16cf4cc4fccb90fb773429b2795/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:09.235454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78cbdcf642b04bab95b267bfea786665'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:09.235454 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78cbdcf642b04bab95b267bfea786665'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:09.244352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-da512c05-2651-4eb6-a7c8-1983b2533051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78cbdcf642b04bab95b267bfea786665'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:09.245105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131e362-c04a-4139-b7a7-59ae9a677739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1bd8618b3e4053958e7c5bb456f8f0, user_id=10d1b16cf4cc4fccb90fb773429b2795, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:09.247771 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131e362-c04a-4139-b7a7-59ae9a677739 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:09.262963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1357/2716] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:08 2022] DELETE /identity/v3/users/78cbdcf642b04bab95b267bfea786665 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:09.267634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716d5cb-1ecb-40b4-a8e0-3115d69b7c05 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:09.267924 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716d5cb-1ecb-40b4-a8e0-3115d69b7c05 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:09.268195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716d5cb-1ecb-40b4-a8e0-3115d69b7c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:09.286933 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6716d5cb-1ecb-40b4-a8e0-3115d69b7c05 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:09.288128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6716d5cb-1ecb-40b4-a8e0-3115d69b7c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:09.351306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1360/2717] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:09 2022] PUT /identity/v3/projects/0d1bd8618b3e4053958e7c5bb456f8f0/users/10d1b16cf4cc4fccb90fb773429b2795/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:09.355249 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e362-c04a-4139-b7a7-59ae9a677739 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:09.361310 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1358/2718] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:09.369430 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716d5cb-1ecb-40b4-a8e0-3115d69b7c05 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:09.371422 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6716d5cb-1ecb-40b4-a8e0-3115d69b7c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:09.423605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:09.427329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e362-c04a-4139-b7a7-59ae9a677739 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:09.432966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84c656-a105-4aac-b180-b604036ee318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:09.433592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84c656-a105-4aac-b180-b604036ee318 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:09.433874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84c656-a105-4aac-b180-b604036ee318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:09.434152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84c656-a105-4aac-b180-b604036ee318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:09.434802 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84c656-a105-4aac-b180-b604036ee318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:09.436406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84c656-a105-4aac-b180-b604036ee318 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:09.449456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1361/2719] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:39:09.453971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84c656-a105-4aac-b180-b604036ee318 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:09.457284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716d5cb-1ecb-40b4-a8e0-3115d69b7c05 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:09.464464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84c656-a105-4aac-b180-b604036ee318 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:09.469747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2a573-6256-4dec-9baf-f2987cc6fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:09.470410 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a573-6256-4dec-9baf-f2987cc6fe9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:09.470686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a573-6256-4dec-9baf-f2987cc6fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:09.470963 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a573-6256-4dec-9baf-f2987cc6fe9d admin admin] PATH_INFO: `/v3/projects/0d1bd8618b3e4053958e7c5bb456f8f0/users/10d1b16cf4cc4fccb90fb773429b2795/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:09.473016 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2a573-6256-4dec-9baf-f2987cc6fe9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1bd8618b3e4053958e7c5bb456f8f0, user_id=10d1b16cf4cc4fccb90fb773429b2795, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:09.475787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2a573-6256-4dec-9baf-f2987cc6fe9d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:09.486637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1362/2720] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:09 2022] PUT /identity/v3/projects/0d1bd8618b3e4053958e7c5bb456f8f0/users/10d1b16cf4cc4fccb90fb773429b2795/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:09.497645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50db978-75f9-4e27-90a7-462641ef4f98 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:09.497930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50db978-75f9-4e27-90a7-462641ef4f98 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:09.498202 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50db978-75f9-4e27-90a7-462641ef4f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:09.508815 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:09.509458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:09.509753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:09.510005 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:09.519464 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:09.524358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:09.524497 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:09.530776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1359/2721] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:09.530958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-b50db978-75f9-4e27-90a7-462641ef4f98 None None] MFA Rules not processed for user `10d1b16cf4cc4fccb90fb773429b2795`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:09.532200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b50db978-75f9-4e27-90a7-462641ef4f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:09.573486 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:09.610525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1363/2722] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:09.621783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:09.623245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:09.719658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d8421-f3f3-4af5-a409-9804b3274aae service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:09.777753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:09.778390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:09.778776 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:09.778944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:09.781723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:09.861388 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:09.867905 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:09.877689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1360/2723] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:10.042807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50db978-75f9-4e27-90a7-462641ef4f98 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:10.049419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-b50db978-75f9-4e27-90a7-462641ef4f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:10.120630 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50db978-75f9-4e27-90a7-462641ef4f98 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:10.125053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:10.125686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:10.125990 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:10.126260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] PATH_INFO: `/v3/projects/354457f72d5a4170b8ff4d2521aefae2` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:10.127967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=354457f72d5a4170b8ff4d2521aefae2)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:10.130487 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:10.154560 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:10.263700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354457f72d5a4170b8ff4d2521aefae2', 'request_id': 'req-f795dd17-3ed1-4d0c-bc19-03611caa5387'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.264427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:10.273794 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354457f72d5a4170b8ff4d2521aefae2', 'request_id': 'req-f795dd17-3ed1-4d0c-bc19-03611caa5387'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.279323 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354457f72d5a4170b8ff4d2521aefae2', 'request_id': 'req-f795dd17-3ed1-4d0c-bc19-03611caa5387'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.354897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] The token cache is being invalidate because project 354457f72d5a4170b8ff4d2521aefae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:10.355191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.355901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.357466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1364/2724] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:10 2022] DELETE /identity/v3/projects/354457f72d5a4170b8ff4d2521aefae2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:10.361559 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:10.373187 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af928b-bf8a-416b-b26c-465ee7a3653f service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:10.435920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:10.436705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:10.436914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:10.437167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] PATH_INFO: `/v3/users/2770932de4b0427d9fc678d01403fcf8` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:10.438390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2770932de4b0427d9fc678d01403fcf8)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:10.440307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:10.642915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2770932de4b0427d9fc678d01403fcf8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.643589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2770932de4b0427d9fc678d01403fcf8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.720237 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2770932de4b0427d9fc678d01403fcf8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.721617 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2770932de4b0427d9fc678d01403fcf8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.737283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-86235ab4-0b0f-485d-97eb-9c955cd28334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2770932de4b0427d9fc678d01403fcf8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:10.752598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1361/2725] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:10 2022] DELETE /identity/v3/users/2770932de4b0427d9fc678d01403fcf8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:11.208177 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:11.209676 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:11.228109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795dd17-3ed1-4d0c-bc19-03611caa5387 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:11.293780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:11.294343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:11.294625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:11.294960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] PATH_INFO: `/v3/projects/a4286bf77d594b1ab938bffd8af3c9c6` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:11.296110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4286bf77d594b1ab938bffd8af3c9c6)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:11.298051 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:11.428226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4286bf77d594b1ab938bffd8af3c9c6', 'request_id': 'req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:11.435117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4286bf77d594b1ab938bffd8af3c9c6', 'request_id': 'req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:11.442107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4286bf77d594b1ab938bffd8af3c9c6', 'request_id': 'req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:11.548369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] The token cache is being invalidate because project a4286bf77d594b1ab938bffd8af3c9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:11.548580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:11.549236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e38edfc4-7dbd-4fbb-8850-7742a6988eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:11.551276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1365/2726] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:11 2022] DELETE /identity/v3/projects/a4286bf77d594b1ab938bffd8af3c9c6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:11.556465 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531765-fba2-4c62-8241-a29abbce3496 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:11.556988 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531765-fba2-4c62-8241-a29abbce3496 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:11.557111 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531765-fba2-4c62-8241-a29abbce3496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:11.577669 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-de531765-fba2-4c62-8241-a29abbce3496 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:11.578898 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-de531765-fba2-4c62-8241-a29abbce3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:11.641099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1362/2727] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:11.649295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bb3d-2e5a-4aa5-83d5-4fc14472fe56 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:11.649577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bb3d-2e5a-4aa5-83d5-4fc14472fe56 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:11.649860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bb3d-2e5a-4aa5-83d5-4fc14472fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:11.670091 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e903bb3d-2e5a-4aa5-83d5-4fc14472fe56 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:11.671297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e903bb3d-2e5a-4aa5-83d5-4fc14472fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:11.683350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1366/2728] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:11.687963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de531765-fba2-4c62-8241-a29abbce3496 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:11.699025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de531765-fba2-4c62-8241-a29abbce3496 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:11.704358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:11.704999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:11.705291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:11.705567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:11.706225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:39:11.706537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:11.708207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:11.709986 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:11.721127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1363/2729] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:39:11.725334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903bb3d-2e5a-4aa5-83d5-4fc14472fe56 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:11.734972 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903bb3d-2e5a-4aa5-83d5-4fc14472fe56 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:11.740958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38a8bc-46f0-47c9-80ac-45d874e1df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:11.744921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38a8bc-46f0-47c9-80ac-45d874e1df87 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:11.744921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38a8bc-46f0-47c9-80ac-45d874e1df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:11.744921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38a8bc-46f0-47c9-80ac-45d874e1df87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:11.744921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38a8bc-46f0-47c9-80ac-45d874e1df87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:11.744921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38a8bc-46f0-47c9-80ac-45d874e1df87 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:11.864390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1367/2730] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:11 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:11.870610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:11.895545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859729b8-e520-4744-9c5a-65683ae1ded1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:11.970792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce706df-1b34-479e-ba9c-3e353ea7a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:11.971407 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce706df-1b34-479e-ba9c-3e353ea7a0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:11.971684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce706df-1b34-479e-ba9c-3e353ea7a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:11.971955 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce706df-1b34-479e-ba9c-3e353ea7a0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:11.973142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce706df-1b34-479e-ba9c-3e353ea7a0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:11.975126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce706df-1b34-479e-ba9c-3e353ea7a0f2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:12.104872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1364/2731] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:11 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:12.109028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38a8bc-46f0-47c9-80ac-45d874e1df87 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:12.121092 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38a8bc-46f0-47c9-80ac-45d874e1df87 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:12.126607 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac482040-8f23-49e0-8dda-a56d3b8f70d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:12.129386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac482040-8f23-49e0-8dda-a56d3b8f70d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:12.129386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac482040-8f23-49e0-8dda-a56d3b8f70d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:12.129386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac482040-8f23-49e0-8dda-a56d3b8f70d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:12.129386 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac482040-8f23-49e0-8dda-a56d3b8f70d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:12.130943 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac482040-8f23-49e0-8dda-a56d3b8f70d3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:12.137039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:12.142393 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1368/2732] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:12.147529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce706df-1b34-479e-ba9c-3e353ea7a0f2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:12.158775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce706df-1b34-479e-ba9c-3e353ea7a0f2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:12.163871 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f712e5-513e-4202-b538-18634fdc8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:12.164502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f712e5-513e-4202-b538-18634fdc8d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:12.164777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f712e5-513e-4202-b538-18634fdc8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:12.165093 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f712e5-513e-4202-b538-18634fdc8d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:12.165754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f712e5-513e-4202-b538-18634fdc8d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:12.167378 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f712e5-513e-4202-b538-18634fdc8d83 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:12.179736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1365/2733] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:39:12.184677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac482040-8f23-49e0-8dda-a56d3b8f70d3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:12.195986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac482040-8f23-49e0-8dda-a56d3b8f70d3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:12.200919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c40de-dc1c-426e-8aaf-554d68ea095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:12.201623 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c40de-dc1c-426e-8aaf-554d68ea095e admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:12.201911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c40de-dc1c-426e-8aaf-554d68ea095e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:12.202190 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c40de-dc1c-426e-8aaf-554d68ea095e admin admin] PATH_INFO: `/v3/projects/2b3947d5a7a2482dbfee6a735a238d5a/users/de640c32050942098c200f2a7dd5fea3/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:12.218348 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c40de-dc1c-426e-8aaf-554d68ea095e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3947d5a7a2482dbfee6a735a238d5a, user_id=de640c32050942098c200f2a7dd5fea3, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:12.221188 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c40de-dc1c-426e-8aaf-554d68ea095e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:12.338052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1369/2734] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:12 2022] PUT /identity/v3/projects/2b3947d5a7a2482dbfee6a735a238d5a/users/de640c32050942098c200f2a7dd5fea3/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:12.344475 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca52486-6ca1-411d-a4fa-2608d78313fa None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:12.344769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca52486-6ca1-411d-a4fa-2608d78313fa None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:12.345090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca52486-6ca1-411d-a4fa-2608d78313fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:12.375810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fca52486-6ca1-411d-a4fa-2608d78313fa None None] MFA Rules not processed for user `de640c32050942098c200f2a7dd5fea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:12.377071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fca52486-6ca1-411d-a4fa-2608d78313fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:12.444570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1366/2735] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:12.449362 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c40de-dc1c-426e-8aaf-554d68ea095e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:12.525557 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c40de-dc1c-426e-8aaf-554d68ea095e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:12.530948 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf5fa-0ea6-43b1-99af-e7596c6667e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:12.531717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf5fa-0ea6-43b1-99af-e7596c6667e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:12.532072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf5fa-0ea6-43b1-99af-e7596c6667e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:12.532349 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf5fa-0ea6-43b1-99af-e7596c6667e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:12.533063 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faf5fa-0ea6-43b1-99af-e7596c6667e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:12.536044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faf5fa-0ea6-43b1-99af-e7596c6667e2 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:12.599366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1370/2736] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:12 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:12.600208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca52486-6ca1-411d-a4fa-2608d78313fa None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:12.611277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca52486-6ca1-411d-a4fa-2608d78313fa None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:12.670122 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6192c-68a1-47ae-a6da-145498a49012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:12.670730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6192c-68a1-47ae-a6da-145498a49012 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:12.671064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6192c-68a1-47ae-a6da-145498a49012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:12.671346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6192c-68a1-47ae-a6da-145498a49012 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:12.672001 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6192c-68a1-47ae-a6da-145498a49012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:12.674038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6192c-68a1-47ae-a6da-145498a49012 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:12.684020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:12.793514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1367/2737] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:12 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:39:12.797738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf5fa-0ea6-43b1-99af-e7596c6667e2 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:12.809162 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf5fa-0ea6-43b1-99af-e7596c6667e2 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:12.814426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc54f59-e468-4931-95d5-264b3c1cbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:12.815041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc54f59-e468-4931-95d5-264b3c1cbacb admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:12.815325 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc54f59-e468-4931-95d5-264b3c1cbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:12.815603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc54f59-e468-4931-95d5-264b3c1cbacb admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:12.816252 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc54f59-e468-4931-95d5-264b3c1cbacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:12.817890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc54f59-e468-4931-95d5-264b3c1cbacb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:12.829203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1371/2738] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:12.833663 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6192c-68a1-47ae-a6da-145498a49012 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:12.844027 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6192c-68a1-47ae-a6da-145498a49012 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:12.849286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf2009-a2a8-40d9-9352-8b2e3e50f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:12.850059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2009-a2a8-40d9-9352-8b2e3e50f8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:12.850352 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2009-a2a8-40d9-9352-8b2e3e50f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:12.850540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2009-a2a8-40d9-9352-8b2e3e50f8ec admin admin] PATH_INFO: `/v3/projects/65352ffbbaaf4ae7b59ad1fdb1cbf7fd/users/41f902934b224cabbf8fbe09093bbe81/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:12.866274 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf2009-a2a8-40d9-9352-8b2e3e50f8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=65352ffbbaaf4ae7b59ad1fdb1cbf7fd, user_id=41f902934b224cabbf8fbe09093bbe81, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:12.869289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf2009-a2a8-40d9-9352-8b2e3e50f8ec admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:12.983195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1368/2739] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:12 2022] PUT /identity/v3/projects/65352ffbbaaf4ae7b59ad1fdb1cbf7fd/users/41f902934b224cabbf8fbe09093bbe81/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:12.987514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc54f59-e468-4931-95d5-264b3c1cbacb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:12.997732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc54f59-e468-4931-95d5-264b3c1cbacb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:13.055989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8236-2e8c-4950-8d01-b33243bdeeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:13.056700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8236-2e8c-4950-8d01-b33243bdeeba admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:13.057009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8236-2e8c-4950-8d01-b33243bdeeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:13.057289 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8236-2e8c-4950-8d01-b33243bdeeba admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:13.057944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c8236-2e8c-4950-8d01-b33243bdeeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:13.059554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c8236-2e8c-4950-8d01-b33243bdeeba admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:13.073302 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1372/2740] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:13.074502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf2009-a2a8-40d9-9352-8b2e3e50f8ec admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:13.085733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf2009-a2a8-40d9-9352-8b2e3e50f8ec admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:13.090695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:13.091339 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:13.091621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:13.091893 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] PATH_INFO: `/v3/projects/65352ffbbaaf4ae7b59ad1fdb1cbf7fd/users/41f902934b224cabbf8fbe09093bbe81/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:13.093963 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65352ffbbaaf4ae7b59ad1fdb1cbf7fd, user_id=41f902934b224cabbf8fbe09093bbe81, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:13.096651 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:13.108107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1369/2741] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:13 2022] PUT /identity/v3/projects/65352ffbbaaf4ae7b59ad1fdb1cbf7fd/users/41f902934b224cabbf8fbe09093bbe81/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:13.118444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399277-9929-46bf-8589-40dcf5cc7da6 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:13.118735 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399277-9929-46bf-8589-40dcf5cc7da6 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:13.119013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc399277-9929-46bf-8589-40dcf5cc7da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:13.149059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-dc399277-9929-46bf-8589-40dcf5cc7da6 None None] MFA Rules not processed for user `41f902934b224cabbf8fbe09093bbe81`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:13.150291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-dc399277-9929-46bf-8589-40dcf5cc7da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:13.191326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:13.227327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1373/2742] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:13.239416 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:13.241225 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:13.307115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00773798-7743-4e53-8e64-5e0b7ab86989 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:13.311052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fecade-9a76-4312-ad9a-d3c32b61c0e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:13.311695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fecade-9a76-4312-ad9a-d3c32b61c0e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:13.312102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fecade-9a76-4312-ad9a-d3c32b61c0e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:13.312272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fecade-9a76-4312-ad9a-d3c32b61c0e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:13.373908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fecade-9a76-4312-ad9a-d3c32b61c0e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:13.375265 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fecade-9a76-4312-ad9a-d3c32b61c0e9 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:13.385258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1370/2743] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:15.937892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc399277-9929-46bf-8589-40dcf5cc7da6 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:15.939353 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-dc399277-9929-46bf-8589-40dcf5cc7da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:15.974765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc399277-9929-46bf-8589-40dcf5cc7da6 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:15.980888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:15.981998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:15.982538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:15.983220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:15.986490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:16.074568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:16.076022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:16.088464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1374/2744] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:17.062443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fecade-9a76-4312-ad9a-d3c32b61c0e9 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:17.072066 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fecade-9a76-4312-ad9a-d3c32b61c0e9 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:17.076059 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:17.076676 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:17.076967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:17.077275 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:17.088832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:17.090315 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:17.101163 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1371/2745] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:18.841438 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:18.842878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:18.936207 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffa85f-48b2-47c4-8093-1062d227c068 service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:18.941980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92470c-c589-420d-a49a-5c54f874ae6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:18.942503 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92470c-c589-420d-a49a-5c54f874ae6b service placement] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:18.942782 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92470c-c589-420d-a49a-5c54f874ae6b service placement] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:18.943057 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92470c-c589-420d-a49a-5c54f874ae6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:18.945048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-df92470c-c589-420d-a49a-5c54f874ae6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:18.958462 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92470c-c589-420d-a49a-5c54f874ae6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:18.960193 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92470c-c589-420d-a49a-5c54f874ae6b service placement] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:18.980738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1375/2746] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:22.092541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:22.095021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:22.160824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:22.166508 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626c8d9-3007-47e7-97c5-f39baeda3333 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:22.171098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:22.171729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:22.172014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:22.176914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] PATH_INFO: `/v3/users/6375c8a11117461f93b6aff4a8018bfe` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:22.176914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6375c8a11117461f93b6aff4a8018bfe)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:22.176914 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:22.535746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6375c8a11117461f93b6aff4a8018bfe'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:22.536471 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6375c8a11117461f93b6aff4a8018bfe'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:22.610982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb619-1381-4cc6-8e1d-7626f1dbbb48 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:22.611572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb619-1381-4cc6-8e1d-7626f1dbbb48 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:22.611572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beb619-1381-4cc6-8e1d-7626f1dbbb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:22.641765 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-38beb619-1381-4cc6-8e1d-7626f1dbbb48 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:22.642893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-38beb619-1381-4cc6-8e1d-7626f1dbbb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:22.650977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6375c8a11117461f93b6aff4a8018bfe'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:22.651604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6375c8a11117461f93b6aff4a8018bfe'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:22.665272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0b559938-c2f2-4094-a3da-69dffc69da90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6375c8a11117461f93b6aff4a8018bfe'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:22.665756 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:22.678741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1372/2747] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:22 2022] DELETE /identity/v3/users/6375c8a11117461f93b6aff4a8018bfe => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:22.683327 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba9967-a8ca-49e9-8485-3db33adb25d4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:22.683620 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba9967-a8ca-49e9-8485-3db33adb25d4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:22.683985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba9967-a8ca-49e9-8485-3db33adb25d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:22.703606 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4dba9967-a8ca-49e9-8485-3db33adb25d4 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:22.704835 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4dba9967-a8ca-49e9-8485-3db33adb25d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:22.710960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1376/2748] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:22.769840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1373/2749] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:22.779426 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beb619-1381-4cc6-8e1d-7626f1dbbb48 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:22.780964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-38beb619-1381-4cc6-8e1d-7626f1dbbb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:22.838379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beb619-1381-4cc6-8e1d-7626f1dbbb48 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:22.887150 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:22.887762 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:22.888040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:22.888311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:22.897825 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:22.899189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:22.908653 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1377/2750] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:22.998253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba9967-a8ca-49e9-8485-3db33adb25d4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:22.999760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4dba9967-a8ca-49e9-8485-3db33adb25d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:23.071395 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba9967-a8ca-49e9-8485-3db33adb25d4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:23.077746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d8de-6269-47d3-9558-6697a69a0951 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:23.078351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d8de-6269-47d3-9558-6697a69a0951 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:23.078630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d8de-6269-47d3-9558-6697a69a0951 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:23.078900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23d8de-6269-47d3-9558-6697a69a0951 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:23.092184 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:23.149817 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d8de-6269-47d3-9558-6697a69a0951 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:23.151528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23d8de-6269-47d3-9558-6697a69a0951 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:23.161128 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1374/2751] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:39:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:39:23.429167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:23.432352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:23.459895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201083-a868-4dfc-ad41-f6034457c47b service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:23.476281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:23.477275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:23.478068 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:23.478566 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] PATH_INFO: `/v3/projects/3f06a273d92d4b3bb49d5d48b552c79b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:23.489693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f06a273d92d4b3bb49d5d48b552c79b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:23.490987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:23.648741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f06a273d92d4b3bb49d5d48b552c79b', 'request_id': 'req-5d84e654-1641-4837-9764-3b90e3671adb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:23.660290 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f06a273d92d4b3bb49d5d48b552c79b', 'request_id': 'req-5d84e654-1641-4837-9764-3b90e3671adb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:23.667927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f06a273d92d4b3bb49d5d48b552c79b', 'request_id': 'req-5d84e654-1641-4837-9764-3b90e3671adb'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:23.739268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] The token cache is being invalidate because project 3f06a273d92d4b3bb49d5d48b552c79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:23.739816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:23.740446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:23.746196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1378/2752] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:23 2022] DELETE /identity/v3/projects/3f06a273d92d4b3bb49d5d48b552c79b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:23.747624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d8de-6269-47d3-9558-6697a69a0951 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:23.760286 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23d8de-6269-47d3-9558-6697a69a0951 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:23.834217 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:23.835024 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:23.835405 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:23.836081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] PATH_INFO: `/v3/users/10d1b16cf4cc4fccb90fb773429b2795` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:23.837608 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d1b16cf4cc4fccb90fb773429b2795)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:23.841154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:24.120540 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d1b16cf4cc4fccb90fb773429b2795'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:24.121589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d1b16cf4cc4fccb90fb773429b2795'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:24.245302 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d1b16cf4cc4fccb90fb773429b2795'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:24.246253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d1b16cf4cc4fccb90fb773429b2795'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:24.266956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b15c81de-49c7-47d7-91ef-a92566e248e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d1b16cf4cc4fccb90fb773429b2795'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:24.281803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1375/2753] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:23 2022] DELETE /identity/v3/users/10d1b16cf4cc4fccb90fb773429b2795 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:25.027070 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:25.028835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:25.049099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e654-1641-4837-9764-3b90e3671adb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:25.056508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:25.119311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:25.120082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:25.120429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:25.120768 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] PATH_INFO: `/v3/projects/0d1bd8618b3e4053958e7c5bb456f8f0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:25.135048 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1bd8618b3e4053958e7c5bb456f8f0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:25.137953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:25.256787 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1bd8618b3e4053958e7c5bb456f8f0', 'request_id': 'req-3fc04744-b14c-4eca-ad92-1fdba7964bd0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:25.263791 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1bd8618b3e4053958e7c5bb456f8f0', 'request_id': 'req-3fc04744-b14c-4eca-ad92-1fdba7964bd0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:25.272805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1bd8618b3e4053958e7c5bb456f8f0', 'request_id': 'req-3fc04744-b14c-4eca-ad92-1fdba7964bd0'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:25.383862 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] The token cache is being invalidate because project 0d1bd8618b3e4053958e7c5bb456f8f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:25.384195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:25.385447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-3fc04744-b14c-4eca-ad92-1fdba7964bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:25.389711 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1379/2754] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:25 2022] DELETE /identity/v3/projects/0d1bd8618b3e4053958e7c5bb456f8f0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:25.396013 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee24d-396b-4ff6-9ee1-24dc53adb114 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:25.396600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee24d-396b-4ff6-9ee1-24dc53adb114 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:25.396600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee24d-396b-4ff6-9ee1-24dc53adb114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:25.424208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2daee24d-396b-4ff6-9ee1-24dc53adb114 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:25.426528 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2daee24d-396b-4ff6-9ee1-24dc53adb114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:25.481773 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:25.517320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1376/2755] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:25.527097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf209-13f8-4aaa-985f-24c85bbab72f None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:25.528059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf209-13f8-4aaa-985f-24c85bbab72f None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:25.528601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf209-13f8-4aaa-985f-24c85bbab72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:25.561549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ec6cf209-13f8-4aaa-985f-24c85bbab72f None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:25.564738 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ec6cf209-13f8-4aaa-985f-24c85bbab72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:25.581792 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1380/2756] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:25.592627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee24d-396b-4ff6-9ee1-24dc53adb114 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:25.636531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee24d-396b-4ff6-9ee1-24dc53adb114 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:25.645072 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:25.646280 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:25.652444 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:25.653040 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:25.654271 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:39:25.654782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:25.657108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:25.691725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1377/2757] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:39:25.693029 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cf209-13f8-4aaa-985f-24c85bbab72f None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:25.706870 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cf209-13f8-4aaa-985f-24c85bbab72f None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:25.713221 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130ec7-efdb-45a1-94a1-d676311f614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:25.713932 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130ec7-efdb-45a1-94a1-d676311f614b admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:25.714218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130ec7-efdb-45a1-94a1-d676311f614b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:25.714496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f130ec7-efdb-45a1-94a1-d676311f614b admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:25.715167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130ec7-efdb-45a1-94a1-d676311f614b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:25.717248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f130ec7-efdb-45a1-94a1-d676311f614b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:25.839084 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1381/2758] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:25 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:25.840136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:25.851395 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba32550-9729-4ff0-b1e4-bd9dcf7187cb admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:25.920573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce6faf-cf1c-4bb2-b8d2-9ec90aba6303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:25.921411 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce6faf-cf1c-4bb2-b8d2-9ec90aba6303 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:25.921833 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce6faf-cf1c-4bb2-b8d2-9ec90aba6303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:25.922142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce6faf-cf1c-4bb2-b8d2-9ec90aba6303 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:25.922937 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce6faf-cf1c-4bb2-b8d2-9ec90aba6303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:25.925060 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce6faf-cf1c-4bb2-b8d2-9ec90aba6303 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:26.245615 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1378/2759] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:25 2022] POST /identity/v3/users => generated 287 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:26.249745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130ec7-efdb-45a1-94a1-d676311f614b admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:26.260690 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f130ec7-efdb-45a1-94a1-d676311f614b admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:26.265538 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ff468-ba9e-4de3-9b02-f5217e62bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:26.266148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ff468-ba9e-4de3-9b02-f5217e62bf81 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:26.266431 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ff468-ba9e-4de3-9b02-f5217e62bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:26.266706 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ff468-ba9e-4de3-9b02-f5217e62bf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:26.267355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ff468-ba9e-4de3-9b02-f5217e62bf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:26.268989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ff468-ba9e-4de3-9b02-f5217e62bf81 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:26.279863 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1382/2760] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:39:26.284133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce6faf-cf1c-4bb2-b8d2-9ec90aba6303 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:26.300346 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce6faf-cf1c-4bb2-b8d2-9ec90aba6303 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:26.306030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1828d14-e76c-4ca0-a80e-5226f8e09faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:26.306717 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828d14-e76c-4ca0-a80e-5226f8e09faa admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:26.306999 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828d14-e76c-4ca0-a80e-5226f8e09faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:26.307324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1828d14-e76c-4ca0-a80e-5226f8e09faa admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:26.307917 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828d14-e76c-4ca0-a80e-5226f8e09faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:26.309561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1828d14-e76c-4ca0-a80e-5226f8e09faa admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:26.324928 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1379/2761] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:26.329753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ff468-ba9e-4de3-9b02-f5217e62bf81 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:26.346013 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ff468-ba9e-4de3-9b02-f5217e62bf81 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:26.351310 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:26.352094 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:26.352464 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:26.352811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] PATH_INFO: `/v3/projects/b0cd82ccc24e44b1b129c40dcaa96d68/users/1a5059e21b5741f7b5a796b10d448772/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:26.374610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cd82ccc24e44b1b129c40dcaa96d68, user_id=1a5059e21b5741f7b5a796b10d448772, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:26.377397 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:26.495578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1383/2762] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:26 2022] PUT /identity/v3/projects/b0cd82ccc24e44b1b129c40dcaa96d68/users/1a5059e21b5741f7b5a796b10d448772/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:26.508201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e9f1-cf5e-4bcb-bebf-ec3ae44e10b8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:26.508747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e9f1-cf5e-4bcb-bebf-ec3ae44e10b8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:26.508747 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845e9f1-cf5e-4bcb-bebf-ec3ae44e10b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:26.546262 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5845e9f1-cf5e-4bcb-bebf-ec3ae44e10b8 None None] MFA Rules not processed for user `1a5059e21b5741f7b5a796b10d448772`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:26.547668 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5845e9f1-cf5e-4bcb-bebf-ec3ae44e10b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:26.641129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1380/2763] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:26.650687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:26.652843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:26.706363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:26.735456 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007460d-8d4b-49bb-b895-5d6cb36dd993 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:26.740991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8416452-a26d-487c-96e7-d3ba7dcfa843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:26.741432 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416452-a26d-487c-96e7-d3ba7dcfa843 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:26.742288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416452-a26d-487c-96e7-d3ba7dcfa843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:26.747285 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8416452-a26d-487c-96e7-d3ba7dcfa843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:26.756785 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8416452-a26d-487c-96e7-d3ba7dcfa843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:26.760129 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8416452-a26d-487c-96e7-d3ba7dcfa843 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:26.768867 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1384/2764] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:31.439180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845e9f1-cf5e-4bcb-bebf-ec3ae44e10b8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:31.492783 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:31.533665 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845e9f1-cf5e-4bcb-bebf-ec3ae44e10b8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:31.543810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:31.544482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:31.544765 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:31.545146 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] PATH_INFO: `/v3/users/1a5059e21b5741f7b5a796b10d448772` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:31.546406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5059e21b5741f7b5a796b10d448772)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:31.548348 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:31.861740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5059e21b5741f7b5a796b10d448772'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:31.862546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5059e21b5741f7b5a796b10d448772'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:31.948120 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5059e21b5741f7b5a796b10d448772'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:31.949408 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5059e21b5741f7b5a796b10d448772'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:31.969250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5059e21b5741f7b5a796b10d448772'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:31.986839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1381/2765] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:31 2022] DELETE /identity/v3/users/1a5059e21b5741f7b5a796b10d448772 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:31.991347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb0c2-682d-4bb7-9357-1afb0de37648 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:31.992045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb0c2-682d-4bb7-9357-1afb0de37648 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:31.992045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb0c2-682d-4bb7-9357-1afb0de37648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:32.013640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-eefbb0c2-682d-4bb7-9357-1afb0de37648 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:32.025717 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-eefbb0c2-682d-4bb7-9357-1afb0de37648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:32.089123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1385/2766] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:32.099221 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:32.101474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:32.215977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47809745-61e7-4989-805c-c5522fb5a142 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:32.220017 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:32.220677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:32.220987 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:32.221278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:32.236983 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:32.238570 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:32.249853 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1382/2767] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:32.781351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb0c2-682d-4bb7-9357-1afb0de37648 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:32.782801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-eefbb0c2-682d-4bb7-9357-1afb0de37648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:32.797097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb0c2-682d-4bb7-9357-1afb0de37648 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:32.803327 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:32.803642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:32.803642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:32.803902 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] PATH_INFO: `/v3/users/de640c32050942098c200f2a7dd5fea3` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:32.813832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de640c32050942098c200f2a7dd5fea3)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:32.813832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:33.093821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:33.095649 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:33.100136 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de640c32050942098c200f2a7dd5fea3'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.101450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de640c32050942098c200f2a7dd5fea3'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.124742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8adf-29a2-4cab-b8bd-9869ba26dabf service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:33.130198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:33.130878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:33.131167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:33.131637 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] PATH_INFO: `/v3/projects/b0cd82ccc24e44b1b129c40dcaa96d68` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:33.132703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cd82ccc24e44b1b129c40dcaa96d68)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:33.134754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:33.216843 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de640c32050942098c200f2a7dd5fea3'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.237752 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de640c32050942098c200f2a7dd5fea3'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.238496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-b77a1c2d-2f60-42ad-9d33-f3d323e3d591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de640c32050942098c200f2a7dd5fea3'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.257712 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1386/2768] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:32 2022] DELETE /identity/v3/users/de640c32050942098c200f2a7dd5fea3 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:33.263468 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:33.264373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf1c8-9e89-4957-aee1-7a36950a8803 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:33.264673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf1c8-9e89-4957-aee1-7a36950a8803 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:33.265123 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcf1c8-9e89-4957-aee1-7a36950a8803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:33.286258 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cd82ccc24e44b1b129c40dcaa96d68', 'request_id': 'req-b7b4d3f1-05b6-4854-8ace-80cf4a191804'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.287572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c6dcf1c8-9e89-4957-aee1-7a36950a8803 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:33.288842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c6dcf1c8-9e89-4957-aee1-7a36950a8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:33.296777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cd82ccc24e44b1b129c40dcaa96d68', 'request_id': 'req-b7b4d3f1-05b6-4854-8ace-80cf4a191804'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.307116 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cd82ccc24e44b1b129c40dcaa96d68', 'request_id': 'req-b7b4d3f1-05b6-4854-8ace-80cf4a191804'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.350603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:33.374714 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1387/2769] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:33.379191 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcf1c8-9e89-4957-aee1-7a36950a8803 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:33.380707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c6dcf1c8-9e89-4957-aee1-7a36950a8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:33.412876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] The token cache is being invalidate because project b0cd82ccc24e44b1b129c40dcaa96d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:33.414816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.420838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b7b4d3f1-05b6-4854-8ace-80cf4a191804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:33.420838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1383/2770] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:33 2022] DELETE /identity/v3/projects/b0cd82ccc24e44b1b129c40dcaa96d68 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:33.425962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492fe-cd3c-47c3-9dbf-932c206b6346 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:33.426473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492fe-cd3c-47c3-9dbf-932c206b6346 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:33.426989 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00492fe-cd3c-47c3-9dbf-932c206b6346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:33.453802 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b00492fe-cd3c-47c3-9dbf-932c206b6346 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:33.456408 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b00492fe-cd3c-47c3-9dbf-932c206b6346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:33.476450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcf1c8-9e89-4957-aee1-7a36950a8803 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:33.481440 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1384/2771] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:33.491370 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991f22-4c92-4962-afce-4496b4209f2a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:33.491656 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991f22-4c92-4962-afce-4496b4209f2a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:33.495379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59991f22-4c92-4962-afce-4496b4209f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:33.497287 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:33.498303 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:33.498892 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:33.499379 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:33.503184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:33.515255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-59991f22-4c92-4962-afce-4496b4209f2a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:33.516523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-59991f22-4c92-4962-afce-4496b4209f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:33.526388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:33.528742 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1385/2772] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:33.535642 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:33.535796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59991f22-4c92-4962-afce-4496b4209f2a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:33.542738 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59991f22-4c92-4962-afce-4496b4209f2a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:33.543895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1388/2773] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:39:33.547973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:33.548705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:33.549129 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:33.549498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:33.550257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:39:33.550686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:33.552675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:33.573882 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1386/2774] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:39:33.575317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:33.608116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd0f8-97ea-4691-ada5-8a81bbaed1bb service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:33.617314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8aeed-ee71-49df-a684-6731bbbae20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:33.618079 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8aeed-ee71-49df-a684-6731bbbae20d admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:33.618442 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8aeed-ee71-49df-a684-6731bbbae20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:33.618727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8aeed-ee71-49df-a684-6731bbbae20d admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:33.619593 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8aeed-ee71-49df-a684-6731bbbae20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:33.622777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8aeed-ee71-49df-a684-6731bbbae20d admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:33.719987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1389/2775] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:33 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:33.720800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:33.738068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d689f7-b9a8-4d2b-906e-240b2de5e1d2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:33.852972 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e654b-cb23-411b-a15f-37c8c78a2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:33.853562 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e654b-cb23-411b-a15f-37c8c78a2067 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:33.853838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e654b-cb23-411b-a15f-37c8c78a2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:33.854164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e654b-cb23-411b-a15f-37c8c78a2067 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:33.854818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e654b-cb23-411b-a15f-37c8c78a2067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:33.858020 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e654b-cb23-411b-a15f-37c8c78a2067 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:33.961788 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1387/2776] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:33 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:39:33.972365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8aeed-ee71-49df-a684-6731bbbae20d admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:33.997697 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8aeed-ee71-49df-a684-6731bbbae20d admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:34.006810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0d30-33d4-4ed9-922a-9894dccfe2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:34.007891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0d30-33d4-4ed9-922a-9894dccfe2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:34.007891 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0d30-33d4-4ed9-922a-9894dccfe2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:34.008389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb0d30-33d4-4ed9-922a-9894dccfe2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:34.008911 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb0d30-33d4-4ed9-922a-9894dccfe2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:34.010778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb0d30-33d4-4ed9-922a-9894dccfe2fa admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:34.028026 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1390/2777] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:34.035073 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e654b-cb23-411b-a15f-37c8c78a2067 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:34.048804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e654b-cb23-411b-a15f-37c8c78a2067 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:34.055876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:34.056868 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:34.057345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:34.057865 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:34.058819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:34.060998 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:34.076028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1388/2778] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:34.080298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0d30-33d4-4ed9-922a-9894dccfe2fa admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:34.091242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb0d30-33d4-4ed9-922a-9894dccfe2fa admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:34.096329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd7b80-46f3-4edc-b816-79305d770559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:34.097093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd7b80-46f3-4edc-b816-79305d770559 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:34.097423 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd7b80-46f3-4edc-b816-79305d770559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:34.097909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd7b80-46f3-4edc-b816-79305d770559 admin admin] PATH_INFO: `/v3/projects/9bc42a5a83df468d8e143b3ea239184b/users/1055416c9d2e482c9d3a88db3af4e479/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:34.099685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:34.101504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:34.126824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126363e-3535-4c79-9561-0b7c60cd6235 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:34.141535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:34.142405 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:34.144019 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:34.144482 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] PATH_INFO: `/v3/projects/2b3947d5a7a2482dbfee6a735a238d5a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:34.146048 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3947d5a7a2482dbfee6a735a238d5a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:34.149641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:34.162053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd7b80-46f3-4edc-b816-79305d770559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc42a5a83df468d8e143b3ea239184b, user_id=1055416c9d2e482c9d3a88db3af4e479, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:34.164827 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd7b80-46f3-4edc-b816-79305d770559 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:34.285082 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1391/2779] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:34 2022] PUT /identity/v3/projects/9bc42a5a83df468d8e143b3ea239184b/users/1055416c9d2e482c9d3a88db3af4e479/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:34.288065 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52685d-57b3-4d73-924e-26b380b07f16 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:34.288351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52685d-57b3-4d73-924e-26b380b07f16 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:34.288631 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52685d-57b3-4d73-924e-26b380b07f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:34.302424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3947d5a7a2482dbfee6a735a238d5a', 'request_id': 'req-697c4c8c-385d-4dfc-88ad-648e03267089'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.313113 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ba52685d-57b3-4d73-924e-26b380b07f16 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:34.314392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ba52685d-57b3-4d73-924e-26b380b07f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:34.317470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3947d5a7a2482dbfee6a735a238d5a', 'request_id': 'req-697c4c8c-385d-4dfc-88ad-648e03267089'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.328866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3947d5a7a2482dbfee6a735a238d5a', 'request_id': 'req-697c4c8c-385d-4dfc-88ad-648e03267089'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.331025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:34.386992 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1392/2780] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:34.398276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52685d-57b3-4d73-924e-26b380b07f16 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:34.400006 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ba52685d-57b3-4d73-924e-26b380b07f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:34.463226 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] The token cache is being invalidate because project 2b3947d5a7a2482dbfee6a735a238d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:34.463769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.464797 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.469004 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1389/2781] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:34 2022] DELETE /identity/v3/projects/2b3947d5a7a2482dbfee6a735a238d5a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:34.472236 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:34.473484 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:34.475498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:34.497499 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52685d-57b3-4d73-924e-26b380b07f16 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:34.499323 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c4c8c-385d-4dfc-88ad-648e03267089 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:34.502463 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:34.503278 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:34.503667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:34.504114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:34.506483 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:34.506685 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:34.506888 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:34.507022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:34.507250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] PATH_INFO: `/v3/users/41f902934b224cabbf8fbe09093bbe81` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:34.508634 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f902934b224cabbf8fbe09093bbe81)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:34.510618 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:34.526283 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:34.527896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:34.540072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1393/2782] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:34.727814 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f902934b224cabbf8fbe09093bbe81'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.728595 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f902934b224cabbf8fbe09093bbe81'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.824992 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f902934b224cabbf8fbe09093bbe81'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.826216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f902934b224cabbf8fbe09093bbe81'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.846417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81c0735b-fd88-4311-bb29-4a9dbabac77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f902934b224cabbf8fbe09093bbe81'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:34.873589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1390/2783] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:34 2022] DELETE /identity/v3/users/41f902934b224cabbf8fbe09093bbe81 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:35.427533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:35.439914 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcccbff-a99c-442b-bc14-659423ac9867 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:35.523453 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:35.524286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:35.524801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:35.525203 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] PATH_INFO: `/v3/projects/65352ffbbaaf4ae7b59ad1fdb1cbf7fd` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:35.526529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65352ffbbaaf4ae7b59ad1fdb1cbf7fd)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:35.528580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:35.699726 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65352ffbbaaf4ae7b59ad1fdb1cbf7fd', 'request_id': 'req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:35.710876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65352ffbbaaf4ae7b59ad1fdb1cbf7fd', 'request_id': 'req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:35.718149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65352ffbbaaf4ae7b59ad1fdb1cbf7fd', 'request_id': 'req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:36.108537 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] The token cache is being invalidate because project 65352ffbbaaf4ae7b59ad1fdb1cbf7fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:36.108913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:36.109688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ec7b85b5-fb25-4ec8-b7e4-e257153f7e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:36.111211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1394/2784] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:35 2022] DELETE /identity/v3/projects/65352ffbbaaf4ae7b59ad1fdb1cbf7fd => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:36.116670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becb71-03b1-43d5-a30d-f810c6be7d64 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.117293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becb71-03b1-43d5-a30d-f810c6be7d64 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.117293 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becb71-03b1-43d5-a30d-f810c6be7d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:36.138516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-18becb71-03b1-43d5-a30d-f810c6be7d64 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:36.139763 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-18becb71-03b1-43d5-a30d-f810c6be7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:36.214830 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1391/2785] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:36.215580 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71171a0-4918-4ec8-85c1-df895f0602f2 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.216085 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71171a0-4918-4ec8-85c1-df895f0602f2 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.216366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71171a0-4918-4ec8-85c1-df895f0602f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:36.247922 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-e71171a0-4918-4ec8-85c1-df895f0602f2 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:36.249660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e71171a0-4918-4ec8-85c1-df895f0602f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:36.261704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1395/2786] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:36.266466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18becb71-03b1-43d5-a30d-f810c6be7d64 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:36.279690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18becb71-03b1-43d5-a30d-f810c6be7d64 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:36.290447 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:36.291335 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.291708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.296820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:36.296820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:39:36.296820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:36.296820 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:36.324733 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1392/2787] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:39:36.326755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71171a0-4918-4ec8-85c1-df895f0602f2 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:36.339636 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71171a0-4918-4ec8-85c1-df895f0602f2 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:36.348128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3e3e-2444-4147-8f79-0055b11546d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:36.352734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3e3e-2444-4147-8f79-0055b11546d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.352734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3e3e-2444-4147-8f79-0055b11546d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.352734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3e3e-2444-4147-8f79-0055b11546d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:36.352734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb3e3e-2444-4147-8f79-0055b11546d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:36.352734 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb3e3e-2444-4147-8f79-0055b11546d3 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:36.461874 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1396/2788] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:36 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:36.465680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:36.481800 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512781-f134-40ad-ba41-176d33ca8799 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:36.564207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:36.580041 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d930f3-a322-4153-b316-3fd663ef9073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:36.580782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d930f3-a322-4153-b316-3fd663ef9073 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.581100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d930f3-a322-4153-b316-3fd663ef9073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.581426 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d930f3-a322-4153-b316-3fd663ef9073 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:36.582938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d930f3-a322-4153-b316-3fd663ef9073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:36.584997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d930f3-a322-4153-b316-3fd663ef9073 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:36.710842 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1393/2789] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:36 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:36.714987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3e3e-2444-4147-8f79-0055b11546d3 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:36.728807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3e3e-2444-4147-8f79-0055b11546d3 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:36.745967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb2b7-90dd-4d82-8bdf-0b4f942a1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:36.746604 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb2b7-90dd-4d82-8bdf-0b4f942a1c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.749956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb2b7-90dd-4d82-8bdf-0b4f942a1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.749956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3cb2b7-90dd-4d82-8bdf-0b4f942a1c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:36.749956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cb2b7-90dd-4d82-8bdf-0b4f942a1c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:36.749956 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3cb2b7-90dd-4d82-8bdf-0b4f942a1c61 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:36.773640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1397/2790] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:36.778030 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d930f3-a322-4153-b316-3fd663ef9073 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:36.791789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d930f3-a322-4153-b316-3fd663ef9073 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:36.797377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a25ad4-a1b8-43a2-b5d7-535b0799797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:36.798142 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25ad4-a1b8-43a2-b5d7-535b0799797f admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.798462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25ad4-a1b8-43a2-b5d7-535b0799797f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.798803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a25ad4-a1b8-43a2-b5d7-535b0799797f admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:36.799588 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a25ad4-a1b8-43a2-b5d7-535b0799797f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:36.802161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a25ad4-a1b8-43a2-b5d7-535b0799797f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:36.816775 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1394/2791] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:36.821512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb2b7-90dd-4d82-8bdf-0b4f942a1c61 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:36.849587 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3cb2b7-90dd-4d82-8bdf-0b4f942a1c61 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:36.855149 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ac9a0-36ac-499a-87cc-04fc4561e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:36.856172 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac9a0-36ac-499a-87cc-04fc4561e5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.856683 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac9a0-36ac-499a-87cc-04fc4561e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.858671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac9a0-36ac-499a-87cc-04fc4561e5b8 admin admin] PATH_INFO: `/v3/projects/17a6952bc8df49b0b73f4915ff473f42/users/36da82a3ffcf4cf587c0aceb2340d2c3/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:36.879601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ac9a0-36ac-499a-87cc-04fc4561e5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a6952bc8df49b0b73f4915ff473f42, user_id=36da82a3ffcf4cf587c0aceb2340d2c3, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:36.886619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ac9a0-36ac-499a-87cc-04fc4561e5b8 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:36.960572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1398/2792] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:36 2022] PUT /identity/v3/projects/17a6952bc8df49b0b73f4915ff473f42/users/36da82a3ffcf4cf587c0aceb2340d2c3/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:36.978872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081528-0c34-4e4c-b3ab-cdb579f7c277 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:36.979190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081528-0c34-4e4c-b3ab-cdb579f7c277 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:36.979960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081528-0c34-4e4c-b3ab-cdb579f7c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:37.045102 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4a081528-0c34-4e4c-b3ab-cdb579f7c277 None None] MFA Rules not processed for user `36da82a3ffcf4cf587c0aceb2340d2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:37.047600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4a081528-0c34-4e4c-b3ab-cdb579f7c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:37.156334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ac9a0-36ac-499a-87cc-04fc4561e5b8 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:37.163057 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1395/2793] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:37.163868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:37.250053 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ac9a0-36ac-499a-87cc-04fc4561e5b8 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:37.258612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687c3c-fa63-472e-99f6-3b6743e65697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:37.258612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687c3c-fa63-472e-99f6-3b6743e65697 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:37.258612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687c3c-fa63-472e-99f6-3b6743e65697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:37.258612 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3687c3c-fa63-472e-99f6-3b6743e65697 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:37.259157 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3687c3c-fa63-472e-99f6-3b6743e65697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:37.261169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3687c3c-fa63-472e-99f6-3b6743e65697 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:37.372140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1399/2794] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:37 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:37.376279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081528-0c34-4e4c-b3ab-cdb579f7c277 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:37.390255 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081528-0c34-4e4c-b3ab-cdb579f7c277 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:37.488515 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6eb1e-d531-4aeb-9e5f-bc91ad69960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:37.491329 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6eb1e-d531-4aeb-9e5f-bc91ad69960a admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:37.494284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6eb1e-d531-4aeb-9e5f-bc91ad69960a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:37.494677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6eb1e-d531-4aeb-9e5f-bc91ad69960a admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:37.500977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6eb1e-d531-4aeb-9e5f-bc91ad69960a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:37.500977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6eb1e-d531-4aeb-9e5f-bc91ad69960a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:37.643706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1396/2795] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:37 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:39:37.648375 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687c3c-fa63-472e-99f6-3b6743e65697 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:37.663562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3687c3c-fa63-472e-99f6-3b6743e65697 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:37.674772 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38d1e-30ff-4db7-9bb6-a469892240e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:37.676567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38d1e-30ff-4db7-9bb6-a469892240e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:37.677385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38d1e-30ff-4db7-9bb6-a469892240e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:37.677886 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38d1e-30ff-4db7-9bb6-a469892240e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:37.679035 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38d1e-30ff-4db7-9bb6-a469892240e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:37.682489 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38d1e-30ff-4db7-9bb6-a469892240e7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:37.700614 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1400/2796] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:37.701368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6eb1e-d531-4aeb-9e5f-bc91ad69960a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:37.715961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6eb1e-d531-4aeb-9e5f-bc91ad69960a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:37.727961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca4f41-21d9-40f6-af3d-e35bcb77e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:37.728598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca4f41-21d9-40f6-af3d-e35bcb77e06a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:37.728874 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca4f41-21d9-40f6-af3d-e35bcb77e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:37.729288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca4f41-21d9-40f6-af3d-e35bcb77e06a admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:37.729916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca4f41-21d9-40f6-af3d-e35bcb77e06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:37.731545 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca4f41-21d9-40f6-af3d-e35bcb77e06a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:37.751688 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1397/2797] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:37.755754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38d1e-30ff-4db7-9bb6-a469892240e7 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:37.771054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38d1e-30ff-4db7-9bb6-a469892240e7 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:37.777779 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc50d3-ffaa-4c86-ac8e-ed00e7798821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:37.778459 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc50d3-ffaa-4c86-ac8e-ed00e7798821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:37.778840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc50d3-ffaa-4c86-ac8e-ed00e7798821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:37.779980 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc50d3-ffaa-4c86-ac8e-ed00e7798821 admin admin] PATH_INFO: `/v3/projects/ef3b094111d347bd8c1123a0300ad00c/users/15bf4e581e4e4dcb9d5b0c94e070a9f6/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:37.815935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc50d3-ffaa-4c86-ac8e-ed00e7798821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3b094111d347bd8c1123a0300ad00c, user_id=15bf4e581e4e4dcb9d5b0c94e070a9f6, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:37.819929 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc50d3-ffaa-4c86-ac8e-ed00e7798821 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:37.909628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1401/2798] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:37 2022] PUT /identity/v3/projects/ef3b094111d347bd8c1123a0300ad00c/users/15bf4e581e4e4dcb9d5b0c94e070a9f6/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:37.921267 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377649d-e3d7-4a79-9aea-853fdcfec682 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:37.921586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377649d-e3d7-4a79-9aea-853fdcfec682 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:37.921827 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377649d-e3d7-4a79-9aea-853fdcfec682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:37.962418 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e377649d-e3d7-4a79-9aea-853fdcfec682 None None] MFA Rules not processed for user `15bf4e581e4e4dcb9d5b0c94e070a9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:37.963810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e377649d-e3d7-4a79-9aea-853fdcfec682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:38.004689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:38.067351 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1398/2799] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:38.073654 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc50d3-ffaa-4c86-ac8e-ed00e7798821 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:38.325424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc50d3-ffaa-4c86-ac8e-ed00e7798821 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:38.335164 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d68a46-6316-4e84-8dd9-e4c0761a53ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:38.336317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d68a46-6316-4e84-8dd9-e4c0761a53ce admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:38.336617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d68a46-6316-4e84-8dd9-e4c0761a53ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:38.337098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d68a46-6316-4e84-8dd9-e4c0761a53ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:38.338318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d68a46-6316-4e84-8dd9-e4c0761a53ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:38.341897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d68a46-6316-4e84-8dd9-e4c0761a53ce admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:38.469368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1402/2800] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:38 2022] POST /identity/v3/projects => generated 387 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:38.471289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377649d-e3d7-4a79-9aea-853fdcfec682 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:38.496810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377649d-e3d7-4a79-9aea-853fdcfec682 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:38.590748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43abff-3736-4ebf-ac0b-e3766e9ce408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:38.591804 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43abff-3736-4ebf-ac0b-e3766e9ce408 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:38.592287 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43abff-3736-4ebf-ac0b-e3766e9ce408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:38.593084 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43abff-3736-4ebf-ac0b-e3766e9ce408 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:38.593906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43abff-3736-4ebf-ac0b-e3766e9ce408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:38.597269 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43abff-3736-4ebf-ac0b-e3766e9ce408 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:38.681031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1399/2801] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:38 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:38.685425 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d68a46-6316-4e84-8dd9-e4c0761a53ce admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:38.696760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d68a46-6316-4e84-8dd9-e4c0761a53ce admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:38.701708 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9354523-cef4-4d59-abca-b95f60806549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:38.702329 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9354523-cef4-4d59-abca-b95f60806549 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:38.706930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9354523-cef4-4d59-abca-b95f60806549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:38.706930 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9354523-cef4-4d59-abca-b95f60806549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:38.708120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9354523-cef4-4d59-abca-b95f60806549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:38.709813 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9354523-cef4-4d59-abca-b95f60806549 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:38.725680 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1403/2802] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:38.729044 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43abff-3736-4ebf-ac0b-e3766e9ce408 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:38.765188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43abff-3736-4ebf-ac0b-e3766e9ce408 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:38.782289 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f05817-db55-48c7-84c6-90a58957f065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:38.787766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05817-db55-48c7-84c6-90a58957f065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:38.787766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05817-db55-48c7-84c6-90a58957f065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:38.787766 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05817-db55-48c7-84c6-90a58957f065 admin admin] PATH_INFO: `/v3/projects/ca3458e48e22487194effd0d4218a277/users/260db694628944348757fc909967556f/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:38.822643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f05817-db55-48c7-84c6-90a58957f065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3458e48e22487194effd0d4218a277, user_id=260db694628944348757fc909967556f, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:38.825799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f05817-db55-48c7-84c6-90a58957f065 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:38.937318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1400/2803] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:38 2022] PUT /identity/v3/projects/ca3458e48e22487194effd0d4218a277/users/260db694628944348757fc909967556f/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:38.943271 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9354523-cef4-4d59-abca-b95f60806549 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:38.961895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9354523-cef4-4d59-abca-b95f60806549 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:39.009922 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:39.102211 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f5847-8e05-48ff-9904-45c8a747fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:39.103629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5847-8e05-48ff-9904-45c8a747fd7b admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:39.104083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5847-8e05-48ff-9904-45c8a747fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:39.104561 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5847-8e05-48ff-9904-45c8a747fd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:39.105450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f5847-8e05-48ff-9904-45c8a747fd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:39.107274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f5847-8e05-48ff-9904-45c8a747fd7b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:39.121603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1404/2804] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:39.128188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f05817-db55-48c7-84c6-90a58957f065 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:39.157201 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f05817-db55-48c7-84c6-90a58957f065 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:39.178460 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:39.179161 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:39.179446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:39.179723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] PATH_INFO: `/v3/projects/ca3458e48e22487194effd0d4218a277/users/260db694628944348757fc909967556f/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:39.184000 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3458e48e22487194effd0d4218a277, user_id=260db694628944348757fc909967556f, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:39.188969 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:39.243627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1401/2805] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:39 2022] PUT /identity/v3/projects/ca3458e48e22487194effd0d4218a277/users/260db694628944348757fc909967556f/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:39.248774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62caaec-774c-4287-8cca-488f51e640ba None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:39.249369 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62caaec-774c-4287-8cca-488f51e640ba None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:39.249807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62caaec-774c-4287-8cca-488f51e640ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:39.327619 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c62caaec-774c-4287-8cca-488f51e640ba None None] MFA Rules not processed for user `260db694628944348757fc909967556f`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:39.329127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c62caaec-774c-4287-8cca-488f51e640ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:39.432222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1405/2806] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:39.448382 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:39.450427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:39.624708 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165c1b8-dffe-495e-9cd7-d70c9aed95b0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:39.637715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822ee6e-4433-45b2-83b4-c35732abb696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:39.638364 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ee6e-4433-45b2-83b4-c35732abb696 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:39.638646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ee6e-4433-45b2-83b4-c35732abb696 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:39.638922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822ee6e-4433-45b2-83b4-c35732abb696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:39.658086 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822ee6e-4433-45b2-83b4-c35732abb696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:39.659542 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822ee6e-4433-45b2-83b4-c35732abb696 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:39.688248 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1402/2807] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:41.508291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62caaec-774c-4287-8cca-488f51e640ba None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:41.511166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c62caaec-774c-4287-8cca-488f51e640ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:41.560109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62caaec-774c-4287-8cca-488f51e640ba None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:41.576106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:41.576864 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:41.577276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:41.577909 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:41.722010 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:41.724461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:41.739220 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1406/2808] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:42.010736 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f9e0-3078-47d3-8e33-44580ce36e0b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:42.012858 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f9e0-3078-47d3-8e33-44580ce36e0b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:42.013362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f9e0-3078-47d3-8e33-44580ce36e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:42.026439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:42.054720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ae96f9e0-3078-47d3-8e33-44580ce36e0b None None] MFA Rules not processed for user `1055416c9d2e482c9d3a88db3af4e479`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:42.056229 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ae96f9e0-3078-47d3-8e33-44580ce36e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:42.128010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1403/2809] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:42.132877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:42.135971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:42.195523 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:42.222446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392f317-a1f8-491e-898b-88b5559c9fad service cinder] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:42.228877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09286750-6503-4833-ade4-4af9ea64d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:42.229549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286750-6503-4833-ade4-4af9ea64d067 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:42.229832 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286750-6503-4833-ade4-4af9ea64d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:42.230107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286750-6503-4833-ade4-4af9ea64d067 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:42.230897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09286750-6503-4833-ade4-4af9ea64d067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:42.232837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09286750-6503-4833-ade4-4af9ea64d067 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:42.418846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1407/2810] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:42 2022] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:42.423113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f9e0-3078-47d3-8e33-44580ce36e0b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:42.434489 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f9e0-3078-47d3-8e33-44580ce36e0b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:42.493390 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce06c46-d3c9-42bf-bef3-0ec1676591cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:42.494014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce06c46-d3c9-42bf-bef3-0ec1676591cc admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:42.494322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce06c46-d3c9-42bf-bef3-0ec1676591cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:42.494636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce06c46-d3c9-42bf-bef3-0ec1676591cc admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:42.495358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce06c46-d3c9-42bf-bef3-0ec1676591cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:42.497374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce06c46-d3c9-42bf-bef3-0ec1676591cc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:42.619133 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1404/2811] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:42 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:39:42.623363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09286750-6503-4833-ade4-4af9ea64d067 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:42.635067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09286750-6503-4833-ade4-4af9ea64d067 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:42.640218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3a992-7bd3-4af4-b43b-a7a9231bf71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:42.641260 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3a992-7bd3-4af4-b43b-a7a9231bf71f admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:42.641663 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3a992-7bd3-4af4-b43b-a7a9231bf71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:42.642009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3a992-7bd3-4af4-b43b-a7a9231bf71f admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:42.643008 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3a992-7bd3-4af4-b43b-a7a9231bf71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:42.645366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3a992-7bd3-4af4-b43b-a7a9231bf71f admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:42.657763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1408/2812] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:42.662232 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce06c46-d3c9-42bf-bef3-0ec1676591cc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:42.673884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce06c46-d3c9-42bf-bef3-0ec1676591cc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:42.678869 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfa970-fb1d-4cc5-ac54-d1e7d03dab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:42.679556 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa970-fb1d-4cc5-ac54-d1e7d03dab64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:42.680110 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa970-fb1d-4cc5-ac54-d1e7d03dab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:42.680379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa970-fb1d-4cc5-ac54-d1e7d03dab64 admin admin] PATH_INFO: `/v3/projects/839cc9fdbca94efd93d0e7ec736911c2/users/270ff2c22a2041a791272040ad7fb319/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:42.697497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfa970-fb1d-4cc5-ac54-d1e7d03dab64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839cc9fdbca94efd93d0e7ec736911c2, user_id=270ff2c22a2041a791272040ad7fb319, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:42.700042 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfa970-fb1d-4cc5-ac54-d1e7d03dab64 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:42.834770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1405/2813] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:42 2022] PUT /identity/v3/projects/839cc9fdbca94efd93d0e7ec736911c2/users/270ff2c22a2041a791272040ad7fb319/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:42.839520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3a992-7bd3-4af4-b43b-a7a9231bf71f admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:42.853404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3a992-7bd3-4af4-b43b-a7a9231bf71f admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:42.918659 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e691912-fad0-494e-8248-7a33a1266121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:42.919292 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e691912-fad0-494e-8248-7a33a1266121 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:42.919577 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e691912-fad0-494e-8248-7a33a1266121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:42.919851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e691912-fad0-494e-8248-7a33a1266121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:42.920536 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e691912-fad0-494e-8248-7a33a1266121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:42.922251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e691912-fad0-494e-8248-7a33a1266121 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:42.936777 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1409/2814] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:42.941957 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfa970-fb1d-4cc5-ac54-d1e7d03dab64 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:42.952488 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfa970-fb1d-4cc5-ac54-d1e7d03dab64 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:42.957181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:42.957823 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:42.958100 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:42.958399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] PATH_INFO: `/v3/projects/839cc9fdbca94efd93d0e7ec736911c2/users/270ff2c22a2041a791272040ad7fb319/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:42.960405 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=839cc9fdbca94efd93d0e7ec736911c2, user_id=270ff2c22a2041a791272040ad7fb319, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:42.963062 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:42.977585 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1406/2815] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:42 2022] PUT /identity/v3/projects/839cc9fdbca94efd93d0e7ec736911c2/users/270ff2c22a2041a791272040ad7fb319/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:43.295997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dfee-685f-4c33-9464-e84d785cfd86 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:43.296455 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dfee-685f-4c33-9464-e84d785cfd86 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:43.296741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dfee-685f-4c33-9464-e84d785cfd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:43.321872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-13f7dfee-685f-4c33-9464-e84d785cfd86 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:43.323866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-13f7dfee-685f-4c33-9464-e84d785cfd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:43.394745 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1410/2816] 10.222.0.39 () {58 vars in 967 bytes} [Mon Sep 5 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:43.409165 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:43.411579 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:43.466245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:43.491358 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adb3d8-c67b-49b0-aa4a-0262ee97cb8f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:43.496887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc2643-68df-4930-aeec-f71c5a865839 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:43.497552 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc2643-68df-4930-aeec-f71c5a865839 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:43.498216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc2643-68df-4930-aeec-f71c5a865839 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:43.498216 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc2643-68df-4930-aeec-f71c5a865839 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:43.506702 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc2643-68df-4930-aeec-f71c5a865839 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:43.508284 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc2643-68df-4930-aeec-f71c5a865839 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:43.516516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1407/2817] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:39:47.150987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7dfee-685f-4c33-9464-e84d785cfd86 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:47.154751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-13f7dfee-685f-4c33-9464-e84d785cfd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:47.266568 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7dfee-685f-4c33-9464-e84d785cfd86 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:47.273514 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:47.274409 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:47.274868 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:47.275964 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] PATH_INFO: `/v3/users/c1de610a786549a7b4d16fabc35c37b9` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:47.278170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1de610a786549a7b4d16fabc35c37b9)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:47.280649 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:47.286658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:47.561041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1de610a786549a7b4d16fabc35c37b9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:47.563773 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1de610a786549a7b4d16fabc35c37b9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:47.645101 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc2643-68df-4930-aeec-f71c5a865839 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:47.656666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1de610a786549a7b4d16fabc35c37b9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:47.678121 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1de610a786549a7b4d16fabc35c37b9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:47.683705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1de610a786549a7b4d16fabc35c37b9'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:47.720939 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1411/2818] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:47 2022] DELETE /identity/v3/users/c1de610a786549a7b4d16fabc35c37b9 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:47.783246 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc2643-68df-4930-aeec-f71c5a865839 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:47.858263 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc5bb1-a109-443c-a8a1-d42d2d94a028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:47.858967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc5bb1-a109-443c-a8a1-d42d2d94a028 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:47.859397 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc5bb1-a109-443c-a8a1-d42d2d94a028 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:47.859675 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc5bb1-a109-443c-a8a1-d42d2d94a028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:47.861809 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-efbc5bb1-a109-443c-a8a1-d42d2d94a028 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:47.966658 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc5bb1-a109-443c-a8a1-d42d2d94a028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:47.968193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc5bb1-a109-443c-a8a1-d42d2d94a028 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:47.982261 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1408/2819] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:48.263572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:48.266678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:48.373905 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaaafe-c02e-43ac-96f3-d9b4a9c01935 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:48.378629 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:48.379264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:48.379551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:48.379830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] PATH_INFO: `/v3/projects/b9ffc1787bc34f56b50fd913abcaaf34` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:48.381040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ffc1787bc34f56b50fd913abcaaf34)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:48.382917 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:48.500789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ffc1787bc34f56b50fd913abcaaf34', 'request_id': 'req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:48.509461 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ffc1787bc34f56b50fd913abcaaf34', 'request_id': 'req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:48.516107 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ffc1787bc34f56b50fd913abcaaf34', 'request_id': 'req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:48.622223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] The token cache is being invalidate because project b9ffc1787bc34f56b50fd913abcaaf34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:48.622582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:48.623250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4049a4f3-5dd9-424f-b40e-4440b6ca8c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:48.627332 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1412/2820] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:48 2022] DELETE /identity/v3/projects/b9ffc1787bc34f56b50fd913abcaaf34 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:48.631153 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3819-9b47-492c-84ad-35539e604267 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:48.631543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3819-9b47-492c-84ad-35539e604267 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:48.631895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3819-9b47-492c-84ad-35539e604267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:48.652810 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c75a3819-9b47-492c-84ad-35539e604267 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:48.654169 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c75a3819-9b47-492c-84ad-35539e604267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:48.700428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:48.722920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1409/2821] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:48.736741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60b88-a9f9-44b8-878c-130c71fee4ce None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:48.736741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60b88-a9f9-44b8-878c-130c71fee4ce None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:48.736741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60b88-a9f9-44b8-878c-130c71fee4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:48.756790 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8da60b88-a9f9-44b8-878c-130c71fee4ce None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:48.768646 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8da60b88-a9f9-44b8-878c-130c71fee4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:48.783184 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1413/2822] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:48.787076 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3819-9b47-492c-84ad-35539e604267 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:48.803373 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3819-9b47-492c-84ad-35539e604267 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:48.812399 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:48.813140 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:48.813534 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:48.813916 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:48.814687 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:39:48.815097 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:48.817561 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:48.842625 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1410/2823] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:39:48.848196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60b88-a9f9-44b8-878c-130c71fee4ce None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:48.878529 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60b88-a9f9-44b8-878c-130c71fee4ce None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:48.885750 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf1f8f-a059-4ac8-8359-b76c49f70d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:48.886533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf1f8f-a059-4ac8-8359-b76c49f70d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:48.886877 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf1f8f-a059-4ac8-8359-b76c49f70d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:48.887224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf1f8f-a059-4ac8-8359-b76c49f70d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:48.887971 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf1f8f-a059-4ac8-8359-b76c49f70d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:48.890055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf1f8f-a059-4ac8-8359-b76c49f70d5c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:48.895668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:49.036118 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1414/2824] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:48 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:49.036242 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:49.046727 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd926da7-039a-400a-a9a9-d1bb67202f88 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:49.147190 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237adef-5256-452b-8102-66a968c5ad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:49.147926 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237adef-5256-452b-8102-66a968c5ad17 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:49.148316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237adef-5256-452b-8102-66a968c5ad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:49.148725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237adef-5256-452b-8102-66a968c5ad17 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:49.149677 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237adef-5256-452b-8102-66a968c5ad17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:49.151962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237adef-5256-452b-8102-66a968c5ad17 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:49.234406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1411/2825] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:49 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:39:49.240378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf1f8f-a059-4ac8-8359-b76c49f70d5c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:49.250595 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf1f8f-a059-4ac8-8359-b76c49f70d5c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:49.258226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc979f7-e6e3-455e-9856-d7505fb36710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:49.259078 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc979f7-e6e3-455e-9856-d7505fb36710 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:49.259355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc979f7-e6e3-455e-9856-d7505fb36710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:49.259728 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc979f7-e6e3-455e-9856-d7505fb36710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:49.260573 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc979f7-e6e3-455e-9856-d7505fb36710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:49.264815 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc979f7-e6e3-455e-9856-d7505fb36710 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:49.286958 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1415/2826] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:49.290601 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237adef-5256-452b-8102-66a968c5ad17 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:49.306494 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237adef-5256-452b-8102-66a968c5ad17 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:49.316098 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1c01-5beb-4ab7-933b-242c3d7e51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:49.316307 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1c01-5beb-4ab7-933b-242c3d7e51b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:49.316604 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1c01-5beb-4ab7-933b-242c3d7e51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:49.317053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1c01-5beb-4ab7-933b-242c3d7e51b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:49.317777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1c01-5beb-4ab7-933b-242c3d7e51b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:49.319821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1c01-5beb-4ab7-933b-242c3d7e51b0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:49.333427 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1412/2827] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:49.339512 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc979f7-e6e3-455e-9856-d7505fb36710 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:49.354228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc979f7-e6e3-455e-9856-d7505fb36710 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:49.361404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:49.362829 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:49.363667 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:49.363987 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] PATH_INFO: `/v3/projects/00b4cdce36f84a6dbaf91f5c18da2a92/users/431d99f31eac42f0983909987ea46d5a/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:49.403317 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b4cdce36f84a6dbaf91f5c18da2a92, user_id=431d99f31eac42f0983909987ea46d5a, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:49.407694 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:49.516562 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1416/2828] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:49 2022] PUT /identity/v3/projects/00b4cdce36f84a6dbaf91f5c18da2a92/users/431d99f31eac42f0983909987ea46d5a/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:49.525167 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145f03d-a8e3-4ece-8753-fdf965cf4281 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:49.525697 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145f03d-a8e3-4ece-8753-fdf965cf4281 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:49.526067 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145f03d-a8e3-4ece-8753-fdf965cf4281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:49.559566 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a145f03d-a8e3-4ece-8753-fdf965cf4281 None None] MFA Rules not processed for user `431d99f31eac42f0983909987ea46d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:49.561172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a145f03d-a8e3-4ece-8753-fdf965cf4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:49.662767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1413/2829] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:39:49.678089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:49.680549 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:49.845635 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e25a-837f-43ca-a368-b298a86f7063 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:49.851105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf1134-cfd8-4c80-acb4-f811ceed9219 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a29dd8d28f44f0b311d167fd39b4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:49.851732 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf1134-cfd8-4c80-acb4-f811ceed9219 service glance] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:49.852011 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf1134-cfd8-4c80-acb4-f811ceed9219 service glance] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:49.852396 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf1134-cfd8-4c80-acb4-f811ceed9219 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:49.882341 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf1134-cfd8-4c80-acb4-f811ceed9219 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:49.883801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf1134-cfd8-4c80-acb4-f811ceed9219 service glance] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:49.896572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1417/2830] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:39:50.143480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7add2-5561-4949-9de7-4d20e5a3e6cc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:50.145252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7add2-5561-4949-9de7-4d20e5a3e6cc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:50.145252 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7add2-5561-4949-9de7-4d20e5a3e6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:50.181913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-daa7add2-5561-4949-9de7-4d20e5a3e6cc None None] MFA Rules not processed for user `270ff2c22a2041a791272040ad7fb319`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:50.183239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-daa7add2-5561-4949-9de7-4d20e5a3e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:50.220228 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:50.270840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1414/2831] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:50.284851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf1134-cfd8-4c80-acb4-f811ceed9219 service glance] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:50.298347 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf1134-cfd8-4c80-acb4-f811ceed9219 service glance] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:50.302857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a29dd8d28f44f0b311d167fd39b4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:50.303435 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:50.303718 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:50.303991 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:50.306138 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:50.380835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:50.382265 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:50.391594 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1418/2832] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:39:50.698594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943bab-94aa-48ea-a6c3-20781935e469 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:50.698594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943bab-94aa-48ea-a6c3-20781935e469 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:50.698594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9943bab-94aa-48ea-a6c3-20781935e469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:50.725719 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b9943bab-94aa-48ea-a6c3-20781935e469 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:50.727025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b9943bab-94aa-48ea-a6c3-20781935e469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:50.788170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1415/2833] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:50.801052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:50.802628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:50.855274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:50.886110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0b017-7d47-4657-ba64-ec521e89d88f service glance] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:50.891875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731531a-11ec-4081-8570-19d313958d24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:50.892520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731531a-11ec-4081-8570-19d313958d24 service swift] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:50.892806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731531a-11ec-4081-8570-19d313958d24 service swift] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:50.893116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731531a-11ec-4081-8570-19d313958d24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:50.902520 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731531a-11ec-4081-8570-19d313958d24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:50.904452 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731531a-11ec-4081-8570-19d313958d24 service swift] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:50.914171 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1419/2834] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:39:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:39:52.872768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9943bab-94aa-48ea-a6c3-20781935e469 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:52.875154 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b9943bab-94aa-48ea-a6c3-20781935e469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:52.963782 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9943bab-94aa-48ea-a6c3-20781935e469 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:52.968640 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:52.969318 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:52.969605 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:52.969886 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] PATH_INFO: `/v3/users/36da82a3ffcf4cf587c0aceb2340d2c3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:52.971061 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=36da82a3ffcf4cf587c0aceb2340d2c3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:52.973643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:53.156792 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36da82a3ffcf4cf587c0aceb2340d2c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:53.157821 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36da82a3ffcf4cf587c0aceb2340d2c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:53.265831 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36da82a3ffcf4cf587c0aceb2340d2c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:53.266686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36da82a3ffcf4cf587c0aceb2340d2c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:53.304283 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36da82a3ffcf4cf587c0aceb2340d2c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:53.306519 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:53.326009 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1416/2835] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:52 2022] DELETE /identity/v3/users/36da82a3ffcf4cf587c0aceb2340d2c3 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:53.330941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00f52-2f2e-4180-b9db-3703c09bb2f0 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:53.332259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00f52-2f2e-4180-b9db-3703c09bb2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:53.332647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe00f52-2f2e-4180-b9db-3703c09bb2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:53.362358 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-efe00f52-2f2e-4180-b9db-3703c09bb2f0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:53.364816 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-efe00f52-2f2e-4180-b9db-3703c09bb2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:53.469525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1420/2836] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:53.479185 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:53.483840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:53.603292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984dd85-51bf-45cc-b210-0767fa2cf7bc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:53.614887 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b6fa2-ee6d-4191-9b17-8b549652b47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:53.615705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6fa2-ee6d-4191-9b17-8b549652b47a service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:53.615705 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6fa2-ee6d-4191-9b17-8b549652b47a service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:53.615985 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6fa2-ee6d-4191-9b17-8b549652b47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:53.628094 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b6fa2-ee6d-4191-9b17-8b549652b47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:53.631035 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b6fa2-ee6d-4191-9b17-8b549652b47a service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:53.645590 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1417/2837] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:39:54.452588 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe00f52-2f2e-4180-b9db-3703c09bb2f0 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:54.454411 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-efe00f52-2f2e-4180-b9db-3703c09bb2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:54.500627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe00f52-2f2e-4180-b9db-3703c09bb2f0 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:54.512973 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:54.513934 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:54.514391 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:54.514853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] PATH_INFO: `/v3/projects/17a6952bc8df49b0b73f4915ff473f42` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:54.517974 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a6952bc8df49b0b73f4915ff473f42)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:54.520569 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:54.667753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a6952bc8df49b0b73f4915ff473f42', 'request_id': 'req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:54.674275 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a6952bc8df49b0b73f4915ff473f42', 'request_id': 'req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:54.680960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a6952bc8df49b0b73f4915ff473f42', 'request_id': 'req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:54.751510 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] The token cache is being invalidate because project 17a6952bc8df49b0b73f4915ff473f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:54.751975 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:54.752842 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:54.755043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1421/2838] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:54 2022] DELETE /identity/v3/projects/17a6952bc8df49b0b73f4915ff473f42 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:54.759537 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b6fa2-ee6d-4191-9b17-8b549652b47a service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:54.771320 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b6fa2-ee6d-4191-9b17-8b549652b47a service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:54.852872 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:54.853543 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:54.853829 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:54.854109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] PATH_INFO: `/v3/users/15bf4e581e4e4dcb9d5b0c94e070a9f6` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:54.855272 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15bf4e581e4e4dcb9d5b0c94e070a9f6)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:54.858720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:55.108770 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15bf4e581e4e4dcb9d5b0c94e070a9f6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:55.110137 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15bf4e581e4e4dcb9d5b0c94e070a9f6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:55.181781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15bf4e581e4e4dcb9d5b0c94e070a9f6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:55.182567 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15bf4e581e4e4dcb9d5b0c94e070a9f6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:55.197250 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15bf4e581e4e4dcb9d5b0c94e070a9f6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:55.226754 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1418/2839] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:54 2022] DELETE /identity/v3/users/15bf4e581e4e4dcb9d5b0c94e070a9f6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:39:55.734054 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:55.738242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:55.771180 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e903e6-94d4-4ce6-aab4-3abc7ea7014e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:55.856274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:55.857378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:55.857895 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:55.858385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] PATH_INFO: `/v3/projects/ef3b094111d347bd8c1123a0300ad00c` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:55.859819 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3b094111d347bd8c1123a0300ad00c)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:55.862025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:55.872352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:55.993225 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3b094111d347bd8c1123a0300ad00c', 'request_id': 'req-655cec28-c234-4d11-bc0d-365a626f51f6'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.004312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3b094111d347bd8c1123a0300ad00c', 'request_id': 'req-655cec28-c234-4d11-bc0d-365a626f51f6'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.012381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3b094111d347bd8c1123a0300ad00c', 'request_id': 'req-655cec28-c234-4d11-bc0d-365a626f51f6'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.085919 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] The token cache is being invalidate because project ef3b094111d347bd8c1123a0300ad00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:56.086546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.087449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.091142 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1422/2840] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:55 2022] DELETE /identity/v3/projects/ef3b094111d347bd8c1123a0300ad00c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:56.095121 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:56.096981 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:56.111723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bd07a-f47c-428a-9f08-6802d4f850a3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:56.122548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:56.215051 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:56.218473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:56.218848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:56.219206 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] PATH_INFO: `/v3/users/260db694628944348757fc909967556f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:56.220586 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260db694628944348757fc909967556f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:56.222852 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:56.443105 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260db694628944348757fc909967556f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.450386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260db694628944348757fc909967556f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.537510 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260db694628944348757fc909967556f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.538195 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260db694628944348757fc909967556f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.553064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa9a635c-06f8-4d81-abdf-7cff42f1aad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260db694628944348757fc909967556f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:56.579202 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1419/2841] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:39:56 2022] DELETE /identity/v3/users/260db694628944348757fc909967556f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:57.098076 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:57.102297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:57.138131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cec28-c234-4d11-bc0d-365a626f51f6 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:57.190243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:57.190915 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:57.191197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:57.191471 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] PATH_INFO: `/v3/projects/ca3458e48e22487194effd0d4218a277` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:57.192617 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3458e48e22487194effd0d4218a277)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:57.194719 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:57.687125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3458e48e22487194effd0d4218a277', 'request_id': 'req-4161a747-98aa-439c-bbfa-bf1ae52459e7'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:57.693913 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3458e48e22487194effd0d4218a277', 'request_id': 'req-4161a747-98aa-439c-bbfa-bf1ae52459e7'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:57.699389 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3458e48e22487194effd0d4218a277', 'request_id': 'req-4161a747-98aa-439c-bbfa-bf1ae52459e7'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:57.815276 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] The token cache is being invalidate because project ca3458e48e22487194effd0d4218a277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:39:57.816143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:57.816724 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-4161a747-98aa-439c-bbfa-bf1ae52459e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:39:57.818359 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1423/2842] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:39:57 2022] DELETE /identity/v3/projects/ca3458e48e22487194effd0d4218a277 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:57.832034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d702bff-b6e7-4453-a510-67f9cb40e955 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:57.832034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d702bff-b6e7-4453-a510-67f9cb40e955 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:57.832034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d702bff-b6e7-4453-a510-67f9cb40e955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:57.847052 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6d702bff-b6e7-4453-a510-67f9cb40e955 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:57.848296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6d702bff-b6e7-4453-a510-67f9cb40e955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:57.921222 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1420/2843] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:57.935238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257187b-2aad-43b7-8b58-03320d8246db None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:57.935238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257187b-2aad-43b7-8b58-03320d8246db None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:57.935238 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257187b-2aad-43b7-8b58-03320d8246db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:57.953673 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-2257187b-2aad-43b7-8b58-03320d8246db None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:57.954810 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2257187b-2aad-43b7-8b58-03320d8246db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:57.970853 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1424/2844] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:57.974949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d702bff-b6e7-4453-a510-67f9cb40e955 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:57.986657 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d702bff-b6e7-4453-a510-67f9cb40e955 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:57.992523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:57.993264 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:57.993758 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:57.994119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:57.994854 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:39:57.995162 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:57.996816 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:58.011718 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1421/2845] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:39:58.016384 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257187b-2aad-43b7-8b58-03320d8246db None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:58.026117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257187b-2aad-43b7-8b58-03320d8246db None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:58.033055 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf7bb5-9e68-4034-94e1-7162c614f8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:58.033896 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf7bb5-9e68-4034-94e1-7162c614f8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:58.034175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf7bb5-9e68-4034-94e1-7162c614f8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:58.034477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf7bb5-9e68-4034-94e1-7162c614f8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:58.035117 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf7bb5-9e68-4034-94e1-7162c614f8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:58.037140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf7bb5-9e68-4034-94e1-7162c614f8f6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:58.055872 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:58.185058 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1425/2846] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:58 2022] POST /identity/v3/projects => generated 407 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:58.189458 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:58.200803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189b209-3843-4c5a-966c-8cb103306f2f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:58.215643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:58.276662 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc4aeb-2221-4dbe-8143-4a04b698b6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:58.277725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc4aeb-2221-4dbe-8143-4a04b698b6ef admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:58.278006 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc4aeb-2221-4dbe-8143-4a04b698b6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:58.278279 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc4aeb-2221-4dbe-8143-4a04b698b6ef admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:58.278929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc4aeb-2221-4dbe-8143-4a04b698b6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:58.280847 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc4aeb-2221-4dbe-8143-4a04b698b6ef admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:58.336714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1422/2847] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:58 2022] POST /identity/v3/users => generated 304 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:39:58.340704 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf7bb5-9e68-4034-94e1-7162c614f8f6 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:58.357599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf7bb5-9e68-4034-94e1-7162c614f8f6 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:58.365924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44902bd-c2ee-4bf0-8e7d-6e2d93ee0fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:58.366709 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44902bd-c2ee-4bf0-8e7d-6e2d93ee0fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:58.367058 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44902bd-c2ee-4bf0-8e7d-6e2d93ee0fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:58.367419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44902bd-c2ee-4bf0-8e7d-6e2d93ee0fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:58.368144 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44902bd-c2ee-4bf0-8e7d-6e2d93ee0fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:58.372106 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44902bd-c2ee-4bf0-8e7d-6e2d93ee0fb5 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:58.384147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1426/2848] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:58.388196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc4aeb-2221-4dbe-8143-4a04b698b6ef admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:58.399334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc4aeb-2221-4dbe-8143-4a04b698b6ef admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:58.405172 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603db9ee-30ac-4c9e-97dd-0de475e1c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:58.405819 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db9ee-30ac-4c9e-97dd-0de475e1c611 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:58.406103 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db9ee-30ac-4c9e-97dd-0de475e1c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:58.406381 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603db9ee-30ac-4c9e-97dd-0de475e1c611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:58.407038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603db9ee-30ac-4c9e-97dd-0de475e1c611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:58.409010 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603db9ee-30ac-4c9e-97dd-0de475e1c611 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:58.424809 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1423/2849] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:39:58.429143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44902bd-c2ee-4bf0-8e7d-6e2d93ee0fb5 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:58.442377 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44902bd-c2ee-4bf0-8e7d-6e2d93ee0fb5 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:58.448608 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026ba2-4c39-45e8-80e6-59d030188f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:58.450167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026ba2-4c39-45e8-80e6-59d030188f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:58.450558 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026ba2-4c39-45e8-80e6-59d030188f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:58.450942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026ba2-4c39-45e8-80e6-59d030188f26 admin admin] PATH_INFO: `/v3/projects/395b164779a64818bca0f4e1f4c2391d/users/ca0b946eece840e3adf75428979ab1cd/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:58.477691 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026ba2-4c39-45e8-80e6-59d030188f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395b164779a64818bca0f4e1f4c2391d, user_id=ca0b946eece840e3adf75428979ab1cd, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:58.480822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026ba2-4c39-45e8-80e6-59d030188f26 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:58.559228 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1427/2850] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:58 2022] PUT /identity/v3/projects/395b164779a64818bca0f4e1f4c2391d/users/ca0b946eece840e3adf75428979ab1cd/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:58.570968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9cf9-0364-47e2-a4d0-9161e87d89c9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:58.571895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9cf9-0364-47e2-a4d0-9161e87d89c9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:58.572476 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9cf9-0364-47e2-a4d0-9161e87d89c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:58.617891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-290d9cf9-0364-47e2-a4d0-9161e87d89c9 None None] MFA Rules not processed for user `ca0b946eece840e3adf75428979ab1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:58.619445 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-290d9cf9-0364-47e2-a4d0-9161e87d89c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:58.728473 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1424/2851] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:58 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:58.729508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026ba2-4c39-45e8-80e6-59d030188f26 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:58.809120 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026ba2-4c39-45e8-80e6-59d030188f26 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:58.817411 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9990-6de1-45cc-97b8-24be4355c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:58.818038 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9990-6de1-45cc-97b8-24be4355c8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:58.818322 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9990-6de1-45cc-97b8-24be4355c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:58.818603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc9990-6de1-45cc-97b8-24be4355c8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:58.819264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc9990-6de1-45cc-97b8-24be4355c8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:58.821243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc9990-6de1-45cc-97b8-24be4355c8bf admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:58.948430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1428/2852] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:39:58 2022] POST /identity/v3/projects => generated 409 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:39:58.949344 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d9cf9-0364-47e2-a4d0-9161e87d89c9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:58.965424 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d9cf9-0364-47e2-a4d0-9161e87d89c9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:59.045715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aed7c-9b2c-43cf-89ec-18b7f9dd96a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:59.046793 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aed7c-9b2c-43cf-89ec-18b7f9dd96a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:59.047091 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aed7c-9b2c-43cf-89ec-18b7f9dd96a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:59.047367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1aed7c-9b2c-43cf-89ec-18b7f9dd96a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:59.048049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1aed7c-9b2c-43cf-89ec-18b7f9dd96a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:59.050533 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1aed7c-9b2c-43cf-89ec-18b7f9dd96a7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:59.181621 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1425/2853] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:39:58 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:39:59.185806 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9990-6de1-45cc-97b8-24be4355c8bf admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:59.198402 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc9990-6de1-45cc-97b8-24be4355c8bf admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:59.203551 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f719-305d-4c86-9988-c71d8a47616a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:59.204380 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f719-305d-4c86-9988-c71d8a47616a admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:59.204873 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f719-305d-4c86-9988-c71d8a47616a admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:59.205281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f719-305d-4c86-9988-c71d8a47616a admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:59.206039 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f719-305d-4c86-9988-c71d8a47616a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:59.209143 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f719-305d-4c86-9988-c71d8a47616a admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:59.237102 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1429/2854] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:39:59.241450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aed7c-9b2c-43cf-89ec-18b7f9dd96a7 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:59.255695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1aed7c-9b2c-43cf-89ec-18b7f9dd96a7 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:59.260636 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfa35f-0b76-48d2-846e-045a2852c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:59.261584 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfa35f-0b76-48d2-846e-045a2852c792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:59.261965 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfa35f-0b76-48d2-846e-045a2852c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:59.262341 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfa35f-0b76-48d2-846e-045a2852c792 admin admin] PATH_INFO: `/v3/projects/9fc9d3c77f004ba393a06c0320eeafa3/users/2d8e2edf108c4aa9b2d80c41c9654326/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:59.277691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:59.281099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfa35f-0b76-48d2-846e-045a2852c792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc9d3c77f004ba393a06c0320eeafa3, user_id=2d8e2edf108c4aa9b2d80c41c9654326, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:59.284034 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfa35f-0b76-48d2-846e-045a2852c792 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:59.385053 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1426/2855] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:59 2022] PUT /identity/v3/projects/9fc9d3c77f004ba393a06c0320eeafa3/users/2d8e2edf108c4aa9b2d80c41c9654326/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:59.386173 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f719-305d-4c86-9988-c71d8a47616a admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:59.400059 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f719-305d-4c86-9988-c71d8a47616a admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:59.491247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c328d56-1f55-450f-9ac5-12314fece35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:59.491866 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c328d56-1f55-450f-9ac5-12314fece35b admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:59.492148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c328d56-1f55-450f-9ac5-12314fece35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:59.492424 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c328d56-1f55-450f-9ac5-12314fece35b admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:59.493140 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c328d56-1f55-450f-9ac5-12314fece35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:59.495110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c328d56-1f55-450f-9ac5-12314fece35b admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:59.506700 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1430/2856] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:39:59.510876 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfa35f-0b76-48d2-846e-045a2852c792 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:59.528686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfa35f-0b76-48d2-846e-045a2852c792 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:59.542603 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:59.543402 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:59.543748 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:59.544088 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] PATH_INFO: `/v3/projects/9fc9d3c77f004ba393a06c0320eeafa3/users/2d8e2edf108c4aa9b2d80c41c9654326/roles/41491b52194f43e2902307fb86036726` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:59.550703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc9d3c77f004ba393a06c0320eeafa3, user_id=2d8e2edf108c4aa9b2d80c41c9654326, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:59.553764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:59.567595 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1427/2857] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:39:59 2022] PUT /identity/v3/projects/9fc9d3c77f004ba393a06c0320eeafa3/users/2d8e2edf108c4aa9b2d80c41c9654326/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:39:59.579301 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e932-5b19-4c2f-a580-14c81f045d66 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:59.579590 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e932-5b19-4c2f-a580-14c81f045d66 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:59.579869 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e932-5b19-4c2f-a580-14c81f045d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:59.616205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-f325e932-5b19-4c2f-a580-14c81f045d66 None None] MFA Rules not processed for user `2d8e2edf108c4aa9b2d80c41c9654326`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:39:59.617685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f325e932-5b19-4c2f-a580-14c81f045d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:59.641194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:39:59.711250 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1431/2858] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:39:59.724934 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:39:59.726643 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:39:59.797287 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c52653-c937-43cf-a297-64c36ae65a5d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:39:59.802087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d69da-6370-4a9c-b2b8-18fc01aed0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:39:59.802784 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d69da-6370-4a9c-b2b8-18fc01aed0af service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:39:59.803117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d69da-6370-4a9c-b2b8-18fc01aed0af service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:39:59.803389 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d69da-6370-4a9c-b2b8-18fc01aed0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:39:59.813863 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d69da-6370-4a9c-b2b8-18fc01aed0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:39:59.815296 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d69da-6370-4a9c-b2b8-18fc01aed0af service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:39:59.837509 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1428/2859] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:39:59 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:00.247399 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e932-5b19-4c2f-a580-14c81f045d66 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:00.258168 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e932-5b19-4c2f-a580-14c81f045d66 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:00.262009 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27981e12-9d7e-4400-a562-90b9cbe203bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:00.262763 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981e12-9d7e-4400-a562-90b9cbe203bb service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:00.263145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981e12-9d7e-4400-a562-90b9cbe203bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:00.263516 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27981e12-9d7e-4400-a562-90b9cbe203bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:00.355817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27981e12-9d7e-4400-a562-90b9cbe203bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:00.357339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27981e12-9d7e-4400-a562-90b9cbe203bb service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:00.367665 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1432/2860] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:00 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:01.799386 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da0a26-5e1c-4e9c-a21d-d04165c8e5c0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:01.800127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da0a26-5e1c-4e9c-a21d-d04165c8e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:01.800127 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da0a26-5e1c-4e9c-a21d-d04165c8e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:01.819396 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-47da0a26-5e1c-4e9c-a21d-d04165c8e5c0 None None] MFA Rules not processed for user `1055416c9d2e482c9d3a88db3af4e479`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:01.820767 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-47da0a26-5e1c-4e9c-a21d-d04165c8e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:01.877962 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1429/2861] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:05.719364 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5468e2-c440-4c70-ab87-18733c0c914e None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:05.719899 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5468e2-c440-4c70-ab87-18733c0c914e None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:05.721183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5468e2-c440-4c70-ab87-18733c0c914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:05.744766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-4a5468e2-c440-4c70-ab87-18733c0c914e None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:05.749567 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-4a5468e2-c440-4c70-ab87-18733c0c914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:05.804796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1433/2862] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Sep 5 12:40:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:05.821314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da0a26-5e1c-4e9c-a21d-d04165c8e5c0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:05.823200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-47da0a26-5e1c-4e9c-a21d-d04165c8e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:05.932760 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da0a26-5e1c-4e9c-a21d-d04165c8e5c0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:05.939367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096cb76-51c7-410d-9048-9553607534a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:05.940362 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cb76-51c7-410d-9048-9553607534a6 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:05.940720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cb76-51c7-410d-9048-9553607534a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:05.941173 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096cb76-51c7-410d-9048-9553607534a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:05.951420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096cb76-51c7-410d-9048-9553607534a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:05.953438 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096cb76-51c7-410d-9048-9553607534a6 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:05.969083 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1430/2863] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:40:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:40:07.724481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5468e2-c440-4c70-ab87-18733c0c914e None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:07.813430 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5468e2-c440-4c70-ab87-18733c0c914e None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:07.829650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:07.831352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:07.832134 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:07.838467 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] PATH_INFO: `/v3/users/ca0b946eece840e3adf75428979ab1cd` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:07.843243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0b946eece840e3adf75428979ab1cd)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:07.847766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:07.851352 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=100 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:08.081803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0b946eece840e3adf75428979ab1cd'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:08.082485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0b946eece840e3adf75428979ab1cd'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:08.135727 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0b946eece840e3adf75428979ab1cd'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:08.150837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0b946eece840e3adf75428979ab1cd'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:08.151571 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0b946eece840e3adf75428979ab1cd'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:08.169585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1434/2864] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:40:07 2022] DELETE /identity/v3/users/ca0b946eece840e3adf75428979ab1cd => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:08.174536 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f259e9-a0ae-42c7-8754-02813602acfe None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:08.175064 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f259e9-a0ae-42c7-8754-02813602acfe None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:08.175194 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f259e9-a0ae-42c7-8754-02813602acfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:08.199623 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e0f259e9-a0ae-42c7-8754-02813602acfe None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:08.200918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e0f259e9-a0ae-42c7-8754-02813602acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:08.212039 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:08.267531 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1431/2865] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:40:08.277105 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:08.278753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:08.339480 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c3b0f-755f-46ac-8d0c-8ab0e3c65e0c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:08.352333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58b3f1-1312-4f69-9699-19f9c63256ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:08.356960 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b3f1-1312-4f69-9699-19f9c63256ca service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:08.357330 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b3f1-1312-4f69-9699-19f9c63256ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:08.357585 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b3f1-1312-4f69-9699-19f9c63256ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:08.368721 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58b3f1-1312-4f69-9699-19f9c63256ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:08.370229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58b3f1-1312-4f69-9699-19f9c63256ca service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:08.382266 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1435/2866] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:08.881156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f259e9-a0ae-42c7-8754-02813602acfe None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:08.882596 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e0f259e9-a0ae-42c7-8754-02813602acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:08.905949 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f259e9-a0ae-42c7-8754-02813602acfe None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:08.913891 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:08.914848 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:08.915474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:08.915921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] PATH_INFO: `/v3/projects/395b164779a64818bca0f4e1f4c2391d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:08.917706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395b164779a64818bca0f4e1f4c2391d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:08.920029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:09.040918 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395b164779a64818bca0f4e1f4c2391d', 'request_id': 'req-df2a4865-1a88-4084-8af8-68e7f46490d1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.048152 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395b164779a64818bca0f4e1f4c2391d', 'request_id': 'req-df2a4865-1a88-4084-8af8-68e7f46490d1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.056068 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395b164779a64818bca0f4e1f4c2391d', 'request_id': 'req-df2a4865-1a88-4084-8af8-68e7f46490d1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.161944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] The token cache is being invalidate because project 395b164779a64818bca0f4e1f4c2391d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:40:09.162450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.163342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.165487 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1432/2867] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:40:08 2022] DELETE /identity/v3/projects/395b164779a64818bca0f4e1f4c2391d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:09.176559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58b3f1-1312-4f69-9699-19f9c63256ca service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:09.187230 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58b3f1-1312-4f69-9699-19f9c63256ca service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:09.266705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:09.267530 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:09.268198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:09.268320 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] PATH_INFO: `/v3/users/2d8e2edf108c4aa9b2d80c41c9654326` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:09.269817 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8e2edf108c4aa9b2d80c41c9654326)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:09.271967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:09.296405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:09.595540 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8e2edf108c4aa9b2d80c41c9654326'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.596198 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8e2edf108c4aa9b2d80c41c9654326'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.724195 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8e2edf108c4aa9b2d80c41c9654326'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.738286 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8e2edf108c4aa9b2d80c41c9654326'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.739050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-44c61160-e7ca-4c8d-8f57-fccf4e344cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8e2edf108c4aa9b2d80c41c9654326'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:09.767049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1436/2868] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:40:09 2022] DELETE /identity/v3/users/2d8e2edf108c4aa9b2d80c41c9654326 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:10.377336 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:10.380196 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:10.395516 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a4865-1a88-4084-8af8-68e7f46490d1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:10.465428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:10.466170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:10.466535 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:10.467469 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] PATH_INFO: `/v3/projects/9fc9d3c77f004ba393a06c0320eeafa3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:10.468938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc9d3c77f004ba393a06c0320eeafa3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:10.471291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:10.559208 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:10.565175 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc9d3c77f004ba393a06c0320eeafa3', 'request_id': 'req-e31204c3-2e6f-4298-8f91-c744a9aa2c17'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:10.571450 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc9d3c77f004ba393a06c0320eeafa3', 'request_id': 'req-e31204c3-2e6f-4298-8f91-c744a9aa2c17'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:10.586806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc9d3c77f004ba393a06c0320eeafa3', 'request_id': 'req-e31204c3-2e6f-4298-8f91-c744a9aa2c17'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:10.793457 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] The token cache is being invalidate because project 9fc9d3c77f004ba393a06c0320eeafa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:40:10.793774 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:10.794467 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e31204c3-2e6f-4298-8f91-c744a9aa2c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:10.796126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1433/2869] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:40:10 2022] DELETE /identity/v3/projects/9fc9d3c77f004ba393a06c0320eeafa3 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:10.831069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89109b47-c07f-4929-ba6f-3544200e53fc None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:10.831688 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89109b47-c07f-4929-ba6f-3544200e53fc None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:10.831884 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89109b47-c07f-4929-ba6f-3544200e53fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:10.854267 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-89109b47-c07f-4929-ba6f-3544200e53fc None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:10.855546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-89109b47-c07f-4929-ba6f-3544200e53fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:10.937027 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1437/2870] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:10.945209 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718457c5-b41b-4922-9b66-a7b902420668 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:10.945582 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718457c5-b41b-4922-9b66-a7b902420668 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:10.945938 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718457c5-b41b-4922-9b66-a7b902420668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:10.996496 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-718457c5-b41b-4922-9b66-a7b902420668 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:11.000251 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-718457c5-b41b-4922-9b66-a7b902420668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:11.039777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1434/2871] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:11.040044 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89109b47-c07f-4929-ba6f-3544200e53fc None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:11.066563 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89109b47-c07f-4929-ba6f-3544200e53fc None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:11.081628 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:11.082334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:11.083130 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:11.083400 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:11.084072 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:40:11.084383 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:11.086028 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:11.112224 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1438/2872] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:40:11.119002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718457c5-b41b-4922-9b66-a7b902420668 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:11.130840 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718457c5-b41b-4922-9b66-a7b902420668 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:11.136791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9e0c3-866c-4ccb-8de8-68afe37e815f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:11.137707 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9e0c3-866c-4ccb-8de8-68afe37e815f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:11.137996 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9e0c3-866c-4ccb-8de8-68afe37e815f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:11.138273 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9e0c3-866c-4ccb-8de8-68afe37e815f admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:11.140345 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9e0c3-866c-4ccb-8de8-68afe37e815f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:11.142158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9e0c3-866c-4ccb-8de8-68afe37e815f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:11.853443 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1435/2873] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:40:11 2022] POST /identity/v3/projects => generated 357 bytes in 740 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:40:11.861470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:11.879609 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389e1e8-e8cf-4968-bfd5-8cac4b9eb7cb admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:11.980253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6137b92-ce8e-461a-8496-8a42bb3f6c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:11.980981 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6137b92-ce8e-461a-8496-8a42bb3f6c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:11.981281 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6137b92-ce8e-461a-8496-8a42bb3f6c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:11.981620 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6137b92-ce8e-461a-8496-8a42bb3f6c67 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:11.983248 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6137b92-ce8e-461a-8496-8a42bb3f6c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:11.986049 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6137b92-ce8e-461a-8496-8a42bb3f6c67 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:12.165860 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1439/2874] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:40:11 2022] POST /identity/v3/users => generated 279 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:40:12.169796 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9e0c3-866c-4ccb-8de8-68afe37e815f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:12.182806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9e0c3-866c-4ccb-8de8-68afe37e815f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:12.188613 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a3141-2706-4a8c-90b1-d1fa1265fd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:12.189437 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3141-2706-4a8c-90b1-d1fa1265fd0a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:12.189762 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3141-2706-4a8c-90b1-d1fa1265fd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:12.190046 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3141-2706-4a8c-90b1-d1fa1265fd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:12.190803 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a3141-2706-4a8c-90b1-d1fa1265fd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:12.202328 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a3141-2706-4a8c-90b1-d1fa1265fd0a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:12.211126 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1436/2875] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:12.215363 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6137b92-ce8e-461a-8496-8a42bb3f6c67 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:12.234807 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6137b92-ce8e-461a-8496-8a42bb3f6c67 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:12.238444 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5479272-74f0-42b7-85af-d86b226dd586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:12.239209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479272-74f0-42b7-85af-d86b226dd586 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:12.239582 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479272-74f0-42b7-85af-d86b226dd586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:12.239953 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5479272-74f0-42b7-85af-d86b226dd586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:12.240741 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5479272-74f0-42b7-85af-d86b226dd586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:12.255468 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5479272-74f0-42b7-85af-d86b226dd586 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:12.277796 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1440/2876] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:12.279253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a3141-2706-4a8c-90b1-d1fa1265fd0a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:12.299832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a3141-2706-4a8c-90b1-d1fa1265fd0a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:12.309414 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:12.311901 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:12.312485 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:12.313031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] PATH_INFO: `/v3/projects/829d669d51104fbe9931ab8fee46b942/users/82ca4cea67d74335bcfd841ab9ad0ecc/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:12.343799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829d669d51104fbe9931ab8fee46b942, user_id=82ca4cea67d74335bcfd841ab9ad0ecc, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:12.347333 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:12.422367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1437/2877] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:40:12 2022] PUT /identity/v3/projects/829d669d51104fbe9931ab8fee46b942/users/82ca4cea67d74335bcfd841ab9ad0ecc/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:12.494789 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bb1b-9589-4131-a16a-a11f23ad98c9 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:12.495131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bb1b-9589-4131-a16a-a11f23ad98c9 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:12.495405 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bb1b-9589-4131-a16a-a11f23ad98c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:12.511243 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:12.537994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-c252bb1b-9589-4131-a16a-a11f23ad98c9 None None] MFA Rules not processed for user `82ca4cea67d74335bcfd841ab9ad0ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:12.539258 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-c252bb1b-9589-4131-a16a-a11f23ad98c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:12.628169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1441/2878] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:12.683462 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:12.685750 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:12.759956 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e2b0a-aef0-45e1-bb89-d05d3c7a9bb4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:12.766888 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb74a1-2a45-450d-84cb-0add316a76e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:12.793947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb74a1-2a45-450d-84cb-0add316a76e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:12.793947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb74a1-2a45-450d-84cb-0add316a76e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:12.793947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb74a1-2a45-450d-84cb-0add316a76e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:12.793947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb74a1-2a45-450d-84cb-0add316a76e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:12.793947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb74a1-2a45-450d-84cb-0add316a76e5 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:12.793947 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1438/2879] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:12.814306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252bb1b-9589-4131-a16a-a11f23ad98c9 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:12.901660 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252bb1b-9589-4131-a16a-a11f23ad98c9 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:12.908603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:12.909312 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:12.909622 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:12.909878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] PATH_INFO: `/v3/users/82ca4cea67d74335bcfd841ab9ad0ecc` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:12.911216 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ca4cea67d74335bcfd841ab9ad0ecc)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:12.913695 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:13.317876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ca4cea67d74335bcfd841ab9ad0ecc'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:13.320093 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ca4cea67d74335bcfd841ab9ad0ecc'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:13.569501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ca4cea67d74335bcfd841ab9ad0ecc'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:13.587733 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ca4cea67d74335bcfd841ab9ad0ecc'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:13.589392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ca4cea67d74335bcfd841ab9ad0ecc'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:13.612553 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1442/2880] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:40:12 2022] DELETE /identity/v3/users/82ca4cea67d74335bcfd841ab9ad0ecc => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:13.618080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac5251-7fd7-4993-9384-7e08633b3632 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:13.618080 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac5251-7fd7-4993-9384-7e08633b3632 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:13.618746 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac5251-7fd7-4993-9384-7e08633b3632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:13.659314 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-19ac5251-7fd7-4993-9384-7e08633b3632 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:13.660921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-19ac5251-7fd7-4993-9384-7e08633b3632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:13.737200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1439/2881] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:13.749984 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:13.751966 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:13.778755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:13.846368 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e54cd1-03ed-4d22-b779-6ff8ecca76ac admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:13.851067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd292fc-4e8a-46f5-915f-a38a3ce42137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:13.852574 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd292fc-4e8a-46f5-915f-a38a3ce42137 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:13.852937 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd292fc-4e8a-46f5-915f-a38a3ce42137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:13.853378 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd292fc-4e8a-46f5-915f-a38a3ce42137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:13.876522 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd292fc-4e8a-46f5-915f-a38a3ce42137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:13.878161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd292fc-4e8a-46f5-915f-a38a3ce42137 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:13.911525 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1443/2882] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:14.594666 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac5251-7fd7-4993-9384-7e08633b3632 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:14.596157 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-19ac5251-7fd7-4993-9384-7e08633b3632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:14.609781 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac5251-7fd7-4993-9384-7e08633b3632 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:14.615043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:14.615713 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:14.615997 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:14.616253 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] PATH_INFO: `/v3/projects/829d669d51104fbe9931ab8fee46b942` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:14.618109 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829d669d51104fbe9931ab8fee46b942)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:14.619470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:14.622319 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:14.765977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829d669d51104fbe9931ab8fee46b942', 'request_id': 'req-255d7877-23f9-4160-a93c-de80f4a44a95'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:14.773856 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829d669d51104fbe9931ab8fee46b942', 'request_id': 'req-255d7877-23f9-4160-a93c-de80f4a44a95'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:14.780016 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829d669d51104fbe9931ab8fee46b942', 'request_id': 'req-255d7877-23f9-4160-a93c-de80f4a44a95'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:14.857181 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] The token cache is being invalidate because project 829d669d51104fbe9931ab8fee46b942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:40:14.857565 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:14.859136 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-255d7877-23f9-4160-a93c-de80f4a44a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:14.860785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1440/2883] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:40:14 2022] DELETE /identity/v3/projects/829d669d51104fbe9931ab8fee46b942 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:14.869970 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d70d-6a5c-4d81-aa09-b69e9c91b519 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:14.870637 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d70d-6a5c-4d81-aa09-b69e9c91b519 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:14.871485 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439d70d-6a5c-4d81-aa09-b69e9c91b519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:14.895967 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-1439d70d-6a5c-4d81-aa09-b69e9c91b519 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:14.897900 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-1439d70d-6a5c-4d81-aa09-b69e9c91b519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:14.975356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1444/2884] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:14.983022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f8cea-091e-4ef8-b623-59e7adebc5d0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:14.983316 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f8cea-091e-4ef8-b623-59e7adebc5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:14.983594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f8cea-091e-4ef8-b623-59e7adebc5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.022632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a36f8cea-091e-4ef8-b623-59e7adebc5d0 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:15.022632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a36f8cea-091e-4ef8-b623-59e7adebc5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:15.027021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1441/2885] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:15.031293 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d70d-6a5c-4d81-aa09-b69e9c91b519 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:15.044356 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439d70d-6a5c-4d81-aa09-b69e9c91b519 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:15.050559 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:15.051334 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.051686 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.052080 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.052753 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81685) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:40:15.053088 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:15.055122 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:15.069552 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1445/2886] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:40:15.073976 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f8cea-091e-4ef8-b623-59e7adebc5d0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:15.083884 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f8cea-091e-4ef8-b623-59e7adebc5d0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:15.091731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f699933-f580-48b8-a582-e71ff49d570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:15.091731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f699933-f580-48b8-a582-e71ff49d570a admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.091731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f699933-f580-48b8-a582-e71ff49d570a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.091731 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f699933-f580-48b8-a582-e71ff49d570a admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.092288 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f699933-f580-48b8-a582-e71ff49d570a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:15.093841 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f699933-f580-48b8-a582-e71ff49d570a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:15.216913 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1442/2887] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:40:15 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:40:15.221200 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:15.232098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db611d-3f43-4b87-99f5-3b82141ffa6e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:15.290137 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812526a9-60b8-48b0-8381-3c82342d48ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:15.290840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812526a9-60b8-48b0-8381-3c82342d48ac admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.291146 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812526a9-60b8-48b0-8381-3c82342d48ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.291447 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812526a9-60b8-48b0-8381-3c82342d48ac admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.292194 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812526a9-60b8-48b0-8381-3c82342d48ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:15.294192 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812526a9-60b8-48b0-8381-3c82342d48ac admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:15.397284 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1446/2888] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:40:15 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:40:15.401624 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f699933-f580-48b8-a582-e71ff49d570a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:15.412725 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f699933-f580-48b8-a582-e71ff49d570a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:15.417406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d3b1-89a9-4295-b7f8-077ff8f3cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:15.418028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d3b1-89a9-4295-b7f8-077ff8f3cec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.418322 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d3b1-89a9-4295-b7f8-077ff8f3cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.418594 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17d3b1-89a9-4295-b7f8-077ff8f3cec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.419257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d3b1-89a9-4295-b7f8-077ff8f3cec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:15.420885 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17d3b1-89a9-4295-b7f8-077ff8f3cec4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:15.431740 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1443/2889] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:15.436156 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812526a9-60b8-48b0-8381-3c82342d48ac admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:15.447774 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812526a9-60b8-48b0-8381-3c82342d48ac admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:15.453147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef586f4-6af9-433e-b836-7e1abd8b1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:15.453147 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef586f4-6af9-433e-b836-7e1abd8b1d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.453440 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef586f4-6af9-433e-b836-7e1abd8b1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.453668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef586f4-6af9-433e-b836-7e1abd8b1d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.454322 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef586f4-6af9-433e-b836-7e1abd8b1d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:15.455922 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef586f4-6af9-433e-b836-7e1abd8b1d64 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:15.467218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1447/2890] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:15.471645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d3b1-89a9-4295-b7f8-077ff8f3cec4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:15.481686 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17d3b1-89a9-4295-b7f8-077ff8f3cec4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:15.486442 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaf802-49f7-4141-8234-78c05e1c33d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:15.487095 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaf802-49f7-4141-8234-78c05e1c33d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.487377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaf802-49f7-4141-8234-78c05e1c33d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.487732 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaf802-49f7-4141-8234-78c05e1c33d2 admin admin] PATH_INFO: `/v3/projects/02d659fd945a4811a1441561147cb407/users/e59937841a7c443b8f712105dba34464/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.503560 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaf802-49f7-4141-8234-78c05e1c33d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d659fd945a4811a1441561147cb407, user_id=e59937841a7c443b8f712105dba34464, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:15.506769 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaf802-49f7-4141-8234-78c05e1c33d2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:15.609480 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1444/2891] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:40:15 2022] PUT /identity/v3/projects/02d659fd945a4811a1441561147cb407/users/e59937841a7c443b8f712105dba34464/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:15.619671 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286a6f0-663d-430c-90e0-d7e0b4455234 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.619988 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286a6f0-663d-430c-90e0-d7e0b4455234 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.620270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286a6f0-663d-430c-90e0-d7e0b4455234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.650780 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-8286a6f0-663d-430c-90e0-d7e0b4455234 None None] MFA Rules not processed for user `e59937841a7c443b8f712105dba34464`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:15.651901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-8286a6f0-663d-430c-90e0-d7e0b4455234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:15.664830 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:15.717857 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1448/2892] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:15.722592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaf802-49f7-4141-8234-78c05e1c33d2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:15.785119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaf802-49f7-4141-8234-78c05e1c33d2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:15.789921 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3649796-28e8-4a72-b3f7-fb3cbe9c3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:15.790524 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3649796-28e8-4a72-b3f7-fb3cbe9c3b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.790894 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3649796-28e8-4a72-b3f7-fb3cbe9c3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.791082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3649796-28e8-4a72-b3f7-fb3cbe9c3b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.791755 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3649796-28e8-4a72-b3f7-fb3cbe9c3b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:15.793791 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3649796-28e8-4a72-b3f7-fb3cbe9c3b33 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:15.897603 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1445/2893] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:40:15 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:40:15.901754 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286a6f0-663d-430c-90e0-d7e0b4455234 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:15.912351 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286a6f0-663d-430c-90e0-d7e0b4455234 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:15.971392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb459d-df67-42e1-a797-a11ec7eaded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:15.972003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb459d-df67-42e1-a797-a11ec7eaded0 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:15.972279 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb459d-df67-42e1-a797-a11ec7eaded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:15.972550 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb459d-df67-42e1-a797-a11ec7eaded0 admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:15.973226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb459d-df67-42e1-a797-a11ec7eaded0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:15.975161 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb459d-df67-42e1-a797-a11ec7eaded0 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:16.140986 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1449/2894] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:40:15 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:40:16.145813 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3649796-28e8-4a72-b3f7-fb3cbe9c3b33 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:16.155555 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3649796-28e8-4a72-b3f7-fb3cbe9c3b33 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:16.160119 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298faf45-f573-456a-a154-10c567a386de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:16.160728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298faf45-f573-456a-a154-10c567a386de admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:16.161043 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298faf45-f573-456a-a154-10c567a386de admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:16.161324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298faf45-f573-456a-a154-10c567a386de admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:16.161977 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298faf45-f573-456a-a154-10c567a386de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:16.163573 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298faf45-f573-456a-a154-10c567a386de admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:16.174794 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1446/2895] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:16.179419 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb459d-df67-42e1-a797-a11ec7eaded0 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:16.189897 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb459d-df67-42e1-a797-a11ec7eaded0 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:16.195390 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766ea74-7ec6-493e-9130-25bec8ba71bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:16.195998 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766ea74-7ec6-493e-9130-25bec8ba71bb admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:16.196319 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766ea74-7ec6-493e-9130-25bec8ba71bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:16.196596 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766ea74-7ec6-493e-9130-25bec8ba71bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:16.197297 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766ea74-7ec6-493e-9130-25bec8ba71bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:16.198894 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766ea74-7ec6-493e-9130-25bec8ba71bb admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:16.208742 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1450/2896] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:16.213670 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298faf45-f573-456a-a154-10c567a386de admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:16.220115 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:16.224903 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298faf45-f573-456a-a154-10c567a386de admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:16.229446 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7366c-b521-419d-9455-da8943a2acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:16.230099 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7366c-b521-419d-9455-da8943a2acf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:16.230377 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7366c-b521-419d-9455-da8943a2acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:16.230646 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7366c-b521-419d-9455-da8943a2acf9 admin admin] PATH_INFO: `/v3/projects/b489e6a2ea1f498091bb73858414e423/users/33e993294be341bf8745f9928439589c/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:16.245878 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7366c-b521-419d-9455-da8943a2acf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b489e6a2ea1f498091bb73858414e423, user_id=33e993294be341bf8745f9928439589c, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:16.248541 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7366c-b521-419d-9455-da8943a2acf9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:16.323951 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1447/2897] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:40:16 2022] PUT /identity/v3/projects/b489e6a2ea1f498091bb73858414e423/users/33e993294be341bf8745f9928439589c/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:16.336052 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ebaa-3256-4659-b1a9-8708aff363a0 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:16.336343 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ebaa-3256-4659-b1a9-8708aff363a0 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:16.336666 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ebaa-3256-4659-b1a9-8708aff363a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:16.366481 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ff47ebaa-3256-4659-b1a9-8708aff363a0 None None] MFA Rules not processed for user `33e993294be341bf8745f9928439589c`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:16.367812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ff47ebaa-3256-4659-b1a9-8708aff363a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:16.432477 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1451/2898] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:16.437015 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7366c-b521-419d-9455-da8943a2acf9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:16.499374 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7366c-b521-419d-9455-da8943a2acf9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:16.504082 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c328cc0-ce19-41f9-91b9-7f911adade75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:16.504716 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c328cc0-ce19-41f9-91b9-7f911adade75 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:16.505022 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c328cc0-ce19-41f9-91b9-7f911adade75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:16.505295 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c328cc0-ce19-41f9-91b9-7f911adade75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:16.505929 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c328cc0-ce19-41f9-91b9-7f911adade75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:16.507808 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c328cc0-ce19-41f9-91b9-7f911adade75 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:16.639922 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1448/2899] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:40:16 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:40:16.644067 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47ebaa-3256-4659-b1a9-8708aff363a0 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:16.655295 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47ebaa-3256-4659-b1a9-8708aff363a0 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:16.674513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:16.712823 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd540d-d596-4294-8ce7-c4010069acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:16.713381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd540d-d596-4294-8ce7-c4010069acdd admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:16.713664 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd540d-d596-4294-8ce7-c4010069acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:16.713941 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd540d-d596-4294-8ce7-c4010069acdd admin admin] PATH_INFO: `/v3/users` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:16.714584 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd540d-d596-4294-8ce7-c4010069acdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:16.716500 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd540d-d596-4294-8ce7-c4010069acdd admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:16.814318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1452/2900] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:40:16 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:40:16.818711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c328cc0-ce19-41f9-91b9-7f911adade75 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:16.829527 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c328cc0-ce19-41f9-91b9-7f911adade75 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:16.835180 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2034a-06ba-4eca-b0b9-a540d12e0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:16.835752 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2034a-06ba-4eca-b0b9-a540d12e0f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:16.836028 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2034a-06ba-4eca-b0b9-a540d12e0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:16.836297 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2034a-06ba-4eca-b0b9-a540d12e0f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:16.837113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2034a-06ba-4eca-b0b9-a540d12e0f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:16.838790 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2034a-06ba-4eca-b0b9-a540d12e0f58 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:16.850723 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1449/2901] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:16.855251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd540d-d596-4294-8ce7-c4010069acdd admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:16.865878 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd540d-d596-4294-8ce7-c4010069acdd admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:16.871288 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483cd04-5463-4c0f-87a3-d0d83103322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:16.877373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483cd04-5463-4c0f-87a3-d0d83103322c admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:16.877373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483cd04-5463-4c0f-87a3-d0d83103322c admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:16.877373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483cd04-5463-4c0f-87a3-d0d83103322c admin admin] PATH_INFO: `/v3/projects/c6ef910c8d7e4967922c52a059895b73/users/c66b5b3ee8d34c0ea5c1d16ee3861a9b/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:16.887610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483cd04-5463-4c0f-87a3-d0d83103322c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ef910c8d7e4967922c52a059895b73, user_id=c66b5b3ee8d34c0ea5c1d16ee3861a9b, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:16.890449 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483cd04-5463-4c0f-87a3-d0d83103322c admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:16.977083 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1453/2902] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:40:16 2022] PUT /identity/v3/projects/c6ef910c8d7e4967922c52a059895b73/users/c66b5b3ee8d34c0ea5c1d16ee3861a9b/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:16.981144 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2034a-06ba-4eca-b0b9-a540d12e0f58 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:16.991975 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2034a-06ba-4eca-b0b9-a540d12e0f58 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:17.053583 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe68d3-871c-49e6-9dd0-0f97c8e26dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:17.054200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe68d3-871c-49e6-9dd0-0f97c8e26dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:17.054650 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe68d3-871c-49e6-9dd0-0f97c8e26dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:17.055063 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe68d3-871c-49e6-9dd0-0f97c8e26dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:17.055728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe68d3-871c-49e6-9dd0-0f97c8e26dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:17.057371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe68d3-871c-49e6-9dd0-0f97c8e26dc2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:17.067332 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1450/2903] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:17.071743 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483cd04-5463-4c0f-87a3-d0d83103322c admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:17.082381 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483cd04-5463-4c0f-87a3-d0d83103322c admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:17.087259 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:17.087944 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:17.088223 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:17.088495 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] PATH_INFO: `/v3/projects/c6ef910c8d7e4967922c52a059895b73/users/c66b5b3ee8d34c0ea5c1d16ee3861a9b/roles/41491b52194f43e2902307fb86036726` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:17.090674 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ef910c8d7e4967922c52a059895b73, user_id=c66b5b3ee8d34c0ea5c1d16ee3861a9b, role_id=41491b52194f43e2902307fb86036726)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:17.093454 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:17.104828 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1454/2904] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:40:17 2022] PUT /identity/v3/projects/c6ef910c8d7e4967922c52a059895b73/users/c66b5b3ee8d34c0ea5c1d16ee3861a9b/roles/41491b52194f43e2902307fb86036726 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:17.115678 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307801da-a3fd-479e-a41e-e494bcc2c749 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:17.115974 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307801da-a3fd-479e-a41e-e494bcc2c749 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:17.116257 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307801da-a3fd-479e-a41e-e494bcc2c749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:17.145780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-307801da-a3fd-479e-a41e-e494bcc2c749 None None] MFA Rules not processed for user `c66b5b3ee8d34c0ea5c1d16ee3861a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:17.147503 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-307801da-a3fd-479e-a41e-e494bcc2c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:17.187188 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:17.217301 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1451/2905] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:17.234116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:17.234116 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:17.297581 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2dd69-8b8c-4d8b-b87a-8ef52aabe806 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:17.302045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb3512-7ce9-4ddb-a371-8f97c242c685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:17.302668 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3512-7ce9-4ddb-a371-8f97c242c685 service cinder] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:17.303017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3512-7ce9-4ddb-a371-8f97c242c685 service cinder] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:17.303318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb3512-7ce9-4ddb-a371-8f97c242c685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:17.366019 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb3512-7ce9-4ddb-a371-8f97c242c685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:17.368446 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb3512-7ce9-4ddb-a371-8f97c242c685 service cinder] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:17.376747 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1455/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:18.887324 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307801da-a3fd-479e-a41e-e494bcc2c749 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:18.888839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-307801da-a3fd-479e-a41e-e494bcc2c749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:18.955474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307801da-a3fd-479e-a41e-e494bcc2c749 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:18.960551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:18.961215 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:18.961497 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:18.961768 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] PATH_INFO: `/v3/users/431d99f31eac42f0983909987ea46d5a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:18.962892 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] RBAC: Authorizing `identity:delete_user(user_id=431d99f31eac42f0983909987ea46d5a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:18.964798 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:19.147728 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431d99f31eac42f0983909987ea46d5a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:19.148599 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431d99f31eac42f0983909987ea46d5a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:19.231081 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431d99f31eac42f0983909987ea46d5a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:19.231824 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431d99f31eac42f0983909987ea46d5a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:19.245826 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431d99f31eac42f0983909987ea46d5a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:19.258935 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1452/2907] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:40:18 2022] DELETE /identity/v3/users/431d99f31eac42f0983909987ea46d5a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:19.263811 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb5a5-5b9a-4547-9049-4be5996a7e60 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:19.264318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb5a5-5b9a-4547-9049-4be5996a7e60 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:19.264318 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb5a5-5b9a-4547-9049-4be5996a7e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:19.284342 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-eb3cb5a5-5b9a-4547-9049-4be5996a7e60 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:19.285572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-eb3cb5a5-5b9a-4547-9049-4be5996a7e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:19.313165 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:19.325756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:19.327170 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:19.350624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1456/2908] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:19.360167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cb5a5-5b9a-4547-9049-4be5996a7e60 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:19.361901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-eb3cb5a5-5b9a-4547-9049-4be5996a7e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:19.385724 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b098077-5b68-417f-8353-cec1bd32162f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:19.389357 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:19.389961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:19.390239 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:19.390523 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:19.392303 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:19.398920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:19.422126 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cb5a5-5b9a-4547-9049-4be5996a7e60 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:19.428037 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:19.428650 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:19.428927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:19.429476 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:19.439346 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:19.440801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:19.451234 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1457/2909] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:40:19.457589 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:19.459058 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:19.469112 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1453/2910] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:19.908443 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:19.911385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:19.924308 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc7900-a362-4210-afbd-63c1a51f5bb4 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:19.929602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:19.930633 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:19.931176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:19.931373 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] PATH_INFO: `/v3/projects/00b4cdce36f84a6dbaf91f5c18da2a92` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:19.932759 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b4cdce36f84a6dbaf91f5c18da2a92)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:19.934766 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:20.053962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b4cdce36f84a6dbaf91f5c18da2a92', 'request_id': 'req-5ac19efc-ad8f-4c6e-9989-df1383007c58'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:20.064371 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b4cdce36f84a6dbaf91f5c18da2a92', 'request_id': 'req-5ac19efc-ad8f-4c6e-9989-df1383007c58'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:20.070355 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b4cdce36f84a6dbaf91f5c18da2a92', 'request_id': 'req-5ac19efc-ad8f-4c6e-9989-df1383007c58'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:20.141339 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] The token cache is being invalidate because project 00b4cdce36f84a6dbaf91f5c18da2a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:40:20.141640 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:20.142298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:20.144114 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1458/2911] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:40:19 2022] DELETE /identity/v3/projects/00b4cdce36f84a6dbaf91f5c18da2a92 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:21.009107 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:21.017729 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cba847-3cb6-49ab-95d9-753be0337076 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:21.068711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388265d-1f78-4270-8f40-1c2facc876f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77ae8a6fe7ff4190aa3cd8c7f820d15b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:21.069354 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388265d-1f78-4270-8f40-1c2facc876f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:21.069641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388265d-1f78-4270-8f40-1c2facc876f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:21.069915 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388265d-1f78-4270-8f40-1c2facc876f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:21.071711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a388265d-1f78-4270-8f40-1c2facc876f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:21.134108 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388265d-1f78-4270-8f40-1c2facc876f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:21.135610 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388265d-1f78-4270-8f40-1c2facc876f6 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:21.145376 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1454/2912] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:25.935901 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:25.937450 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:25.998564 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:26.003655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac19efc-ad8f-4c6e-9989-df1383007c58 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:26.008299 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:26.008924 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:26.009229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:26.009496 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] PATH_INFO: `/v3/users/e59937841a7c443b8f712105dba34464` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:26.010677 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59937841a7c443b8f712105dba34464)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:26.012625 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:26.251472 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59937841a7c443b8f712105dba34464'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:26.252041 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59937841a7c443b8f712105dba34464'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:26.334931 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59937841a7c443b8f712105dba34464'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:26.348592 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59937841a7c443b8f712105dba34464'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:26.349264 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59937841a7c443b8f712105dba34464'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:26.361469 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1459/2913] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:40:25 2022] DELETE /identity/v3/users/e59937841a7c443b8f712105dba34464 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:26.366071 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b815a7-2a60-4406-8377-8454f294e73a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:26.366580 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b815a7-2a60-4406-8377-8454f294e73a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:26.366691 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b815a7-2a60-4406-8377-8454f294e73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:26.385470 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c5b815a7-2a60-4406-8377-8454f294e73a None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:26.386680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c5b815a7-2a60-4406-8377-8454f294e73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:26.436689 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:26.445866 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1455/2914] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:26.455603 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:26.457861 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:26.515854 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bacce0-ba57-417b-b1fe-094f7d356275 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:26.519942 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ab4c8-2473-4508-9e88-46d9226fd6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:26.520554 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab4c8-2473-4508-9e88-46d9226fd6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:26.525209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab4c8-2473-4508-9e88-46d9226fd6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:26.525209 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab4c8-2473-4508-9e88-46d9226fd6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:26.531189 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ab4c8-2473-4508-9e88-46d9226fd6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:26.533376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ab4c8-2473-4508-9e88-46d9226fd6f7 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:26.550270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1460/2915] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:27.052156 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b815a7-2a60-4406-8377-8454f294e73a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:27.054212 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c5b815a7-2a60-4406-8377-8454f294e73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:27.071529 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b815a7-2a60-4406-8377-8454f294e73a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:27.076645 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:27.077653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:27.077875 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:27.078151 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] PATH_INFO: `/v3/projects/02d659fd945a4811a1441561147cb407` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:27.079632 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d659fd945a4811a1441561147cb407)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:27.082481 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:27.199379 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d659fd945a4811a1441561147cb407', 'request_id': 'req-6b2764bc-d1d2-4f2b-9353-e68729d28d47'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.205653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d659fd945a4811a1441561147cb407', 'request_id': 'req-6b2764bc-d1d2-4f2b-9353-e68729d28d47'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.211428 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d659fd945a4811a1441561147cb407', 'request_id': 'req-6b2764bc-d1d2-4f2b-9353-e68729d28d47'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.312179 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] The token cache is being invalidate because project 02d659fd945a4811a1441561147cb407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:40:27.312592 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.313260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.315598 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1456/2916] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:40:27 2022] DELETE /identity/v3/projects/02d659fd945a4811a1441561147cb407 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:27.320251 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ab4c8-2473-4508-9e88-46d9226fd6f7 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:27.330247 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ab4c8-2473-4508-9e88-46d9226fd6f7 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:27.388296 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:27.394385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:27.394385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:27.394385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] PATH_INFO: `/v3/users/33e993294be341bf8745f9928439589c` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:27.394385 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e993294be341bf8745f9928439589c)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:27.395099 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:27.417167 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:27.569933 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e993294be341bf8745f9928439589c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.570508 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e993294be341bf8745f9928439589c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.624846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e993294be341bf8745f9928439589c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.638927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e993294be341bf8745f9928439589c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.639600 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e993294be341bf8745f9928439589c'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:27.653246 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1461/2917] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:40:27 2022] DELETE /identity/v3/users/33e993294be341bf8745f9928439589c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:28.048118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:28.049692 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:28.066908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2764bc-d1d2-4f2b-9353-e68729d28d47 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:28.127780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:28.128415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:28.128695 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:28.128991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] PATH_INFO: `/v3/projects/b489e6a2ea1f498091bb73858414e423` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:28.130270 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b489e6a2ea1f498091bb73858414e423)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:28.132199 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:28.285025 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b489e6a2ea1f498091bb73858414e423', 'request_id': 'req-f2962f66-10d0-4a61-916a-b436b26d0447'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.291498 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b489e6a2ea1f498091bb73858414e423', 'request_id': 'req-f2962f66-10d0-4a61-916a-b436b26d0447'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.297406 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b489e6a2ea1f498091bb73858414e423', 'request_id': 'req-f2962f66-10d0-4a61-916a-b436b26d0447'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.384703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] The token cache is being invalidate because project b489e6a2ea1f498091bb73858414e423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:40:28.384919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.385614 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.388991 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1457/2918] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:40:28 2022] DELETE /identity/v3/projects/b489e6a2ea1f498091bb73858414e423 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:28.391145 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:28.393003 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:28.406800 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca969d78-18a5-4de5-bbaf-019ee63d1a26 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:28.463851 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:28.464490 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:28.464770 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:28.465089 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] PATH_INFO: `/v3/users/c66b5b3ee8d34c0ea5c1d16ee3861a9b` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:28.466206 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66b5b3ee8d34c0ea5c1d16ee3861a9b)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:28.468151 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:28.656624 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66b5b3ee8d34c0ea5c1d16ee3861a9b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.657262 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66b5b3ee8d34c0ea5c1d16ee3861a9b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.721840 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66b5b3ee8d34c0ea5c1d16ee3861a9b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.734722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66b5b3ee8d34c0ea5c1d16ee3861a9b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.735350 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66b5b3ee8d34c0ea5c1d16ee3861a9b'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:28.747270 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1462/2919] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:40:28 2022] DELETE /identity/v3/users/c66b5b3ee8d34c0ea5c1d16ee3861a9b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:29.163745 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:29.165889 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:29.178600 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962f66-10d0-4a61-916a-b436b26d0447 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:29.196479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:29.249245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:29.252368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:29.252368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:29.252368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] PATH_INFO: `/v3/projects/c6ef910c8d7e4967922c52a059895b73` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:29.252368 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ef910c8d7e4967922c52a059895b73)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:29.253711 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:29.306097 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:29.307511 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:29.330803 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:29.371801 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e74c04-0e17-4485-b7c3-77bf87fe62e6 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:29.377449 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ef910c8d7e4967922c52a059895b73', 'request_id': 'req-734b2ac5-c33f-4ed7-b990-65fa95c001d3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:29.384653 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ef910c8d7e4967922c52a059895b73', 'request_id': 'req-734b2ac5-c33f-4ed7-b990-65fa95c001d3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:29.390417 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ef910c8d7e4967922c52a059895b73', 'request_id': 'req-734b2ac5-c33f-4ed7-b990-65fa95c001d3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:29.421466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593b7b2-298b-4c4d-978b-4f996bd57bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:29.422069 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b7b2-298b-4c4d-978b-4f996bd57bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:29.422893 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b7b2-298b-4c4d-978b-4f996bd57bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:29.423205 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593b7b2-298b-4c4d-978b-4f996bd57bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:29.425126 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-3593b7b2-298b-4c4d-978b-4f996bd57bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:29.483274 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] The token cache is being invalidate because project c6ef910c8d7e4967922c52a059895b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:40:29.483593 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:29.484193 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-734b2ac5-c33f-4ed7-b990-65fa95c001d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:29.485739 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1458/2920] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:40:29 2022] DELETE /identity/v3/projects/c6ef910c8d7e4967922c52a059895b73 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:29.490960 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40aadb-73ae-48f7-aa8e-cbc70aea5d4c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:29.491245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40aadb-73ae-48f7-aa8e-cbc70aea5d4c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:29.491548 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40aadb-73ae-48f7-aa8e-cbc70aea5d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:29.492513 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593b7b2-298b-4c4d-978b-4f996bd57bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:29.494127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593b7b2-298b-4c4d-978b-4f996bd57bb2 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:29.505338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1463/2921] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:40:29.512245 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1d40aadb-73ae-48f7-aa8e-cbc70aea5d4c None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:29.513490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1d40aadb-73ae-48f7-aa8e-cbc70aea5d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:29.577764 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1459/2922] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:40:29.590977 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1791cc-8979-4846-bfdd-1eec41f3c694 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:29.591269 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1791cc-8979-4846-bfdd-1eec41f3c694 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:29.591578 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1791cc-8979-4846-bfdd-1eec41f3c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:29.612547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ee1791cc-8979-4846-bfdd-1eec41f3c694 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:29.614354 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ee1791cc-8979-4846-bfdd-1eec41f3c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:29.622314 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1464/2923] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:29.626741 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40aadb-73ae-48f7-aa8e-cbc70aea5d4c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:29.637130 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40aadb-73ae-48f7-aa8e-cbc70aea5d4c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:29.641839 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:29.642448 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:29.642730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:29.643002 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:29.643652 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:40:29.643961 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:29.645722 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:29.662118 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1460/2924] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Sep 5 12:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:40:29.663298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1791cc-8979-4846-bfdd-1eec41f3c694 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:29.672921 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1791cc-8979-4846-bfdd-1eec41f3c694 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:29.678229 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038ae5e-4cab-4612-a643-fd61ad64af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:29.678835 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ae5e-4cab-4612-a643-fd61ad64af09 admin admin] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:29.679132 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ae5e-4cab-4612-a643-fd61ad64af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:29.679404 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ae5e-4cab-4612-a643-fd61ad64af09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:29.680298 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038ae5e-4cab-4612-a643-fd61ad64af09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:29.682218 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038ae5e-4cab-4612-a643-fd61ad64af09 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:29.763760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1465/2925] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Sep 5 12:40:29 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:40:29.768247 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:29.778574 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18edd8-3528-49b4-9620-4ad95d769f36 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:29.807785 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:29.844860 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831d84-8950-4c03-a05e-edd084cd2c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:29.845502 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831d84-8950-4c03-a05e-edd084cd2c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:29.845780 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831d84-8950-4c03-a05e-edd084cd2c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:29.846054 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831d84-8950-4c03-a05e-edd084cd2c47 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:29.846706 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c831d84-8950-4c03-a05e-edd084cd2c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:29.849200 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c831d84-8950-4c03-a05e-edd084cd2c47 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:29.963806 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1461/2926] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Sep 5 12:40:29 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:40:29.967955 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038ae5e-4cab-4612-a643-fd61ad64af09 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:29.979152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038ae5e-4cab-4612-a643-fd61ad64af09 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:29.983788 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c218f-b05b-4207-873f-46ed05f4caba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:29.984429 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c218f-b05b-4207-873f-46ed05f4caba admin admin] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:29.984705 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c218f-b05b-4207-873f-46ed05f4caba admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:29.985042 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c218f-b05b-4207-873f-46ed05f4caba admin admin] PATH_INFO: `/v3/roles` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:29.985687 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c218f-b05b-4207-873f-46ed05f4caba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:29.987268 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c218f-b05b-4207-873f-46ed05f4caba admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:29.998406 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1466/2927] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:40:30.003490 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831d84-8950-4c03-a05e-edd084cd2c47 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:30.017192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831d84-8950-4c03-a05e-edd084cd2c47 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:30.022799 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec923aa-e190-4ef0-b6fc-507194d877ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:30.023420 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec923aa-e190-4ef0-b6fc-507194d877ab admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:30.023683 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec923aa-e190-4ef0-b6fc-507194d877ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:30.023954 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec923aa-e190-4ef0-b6fc-507194d877ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:30.024703 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec923aa-e190-4ef0-b6fc-507194d877ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:30.026334 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec923aa-e190-4ef0-b6fc-507194d877ab admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:30.038038 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1462/2928] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Sep 5 12:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:40:30.042466 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c218f-b05b-4207-873f-46ed05f4caba admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:30.053022 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c218f-b05b-4207-873f-46ed05f4caba admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:30.057927 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:30.058645 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:30.059050 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:30.059291 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] PATH_INFO: `/v3/projects/8b04c17710104a448d3ee8a7109c7df0/users/412d4bf68a1148ea8fd550fadb1d11a9/roles/b63ccf0f2ba84473bd7b8ef888c937af` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:30.075710 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b04c17710104a448d3ee8a7109c7df0, user_id=412d4bf68a1148ea8fd550fadb1d11a9, role_id=b63ccf0f2ba84473bd7b8ef888c937af)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:30.078658 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:30.146527 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1467/2929] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Sep 5 12:40:30 2022] PUT /identity/v3/projects/8b04c17710104a448d3ee8a7109c7df0/users/412d4bf68a1148ea8fd550fadb1d11a9/roles/b63ccf0f2ba84473bd7b8ef888c937af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:30.156968 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57c87f-eb84-4de5-932c-ccc71cddf3cf None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:30.157908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57c87f-eb84-4de5-932c-ccc71cddf3cf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:30.158260 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57c87f-eb84-4de5-932c-ccc71cddf3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:30.190967 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9f57c87f-eb84-4de5-932c-ccc71cddf3cf None None] MFA Rules not processed for user `412d4bf68a1148ea8fd550fadb1d11a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:30.192690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9f57c87f-eb84-4de5-932c-ccc71cddf3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:30.262569 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1463/2930] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:40:30.274293 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:30.276127 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:30.297333 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:30.337470 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54aaa71-69ee-4291-b900-e4a9cdbec9a4 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:30.341242 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccde14-be49-4196-ae55-3a55421406d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66a29dd8d28f44f0b311d167fd39b4f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:30.341849 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccde14-be49-4196-ae55-3a55421406d9 service glance] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:30.342169 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccde14-be49-4196-ae55-3a55421406d9 service glance] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:30.342445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccde14-be49-4196-ae55-3a55421406d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:30.351222 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccde14-be49-4196-ae55-3a55421406d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:30.353601 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccde14-be49-4196-ae55-3a55421406d9 service glance] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:30.362026 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1468/2931] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:40.259056 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:40.367501 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=18 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:40:55.654641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57c87f-eb84-4de5-932c-ccc71cddf3cf None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:55.717789 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57c87f-eb84-4de5-932c-ccc71cddf3cf None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:55.722421 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:55.723090 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:55.723365 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:55.723644 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] PATH_INFO: `/v3/users/412d4bf68a1148ea8fd550fadb1d11a9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:55.724777 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=412d4bf68a1148ea8fd550fadb1d11a9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:55.726730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:55.905595 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412d4bf68a1148ea8fd550fadb1d11a9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:55.906183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412d4bf68a1148ea8fd550fadb1d11a9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:55.997049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412d4bf68a1148ea8fd550fadb1d11a9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:55.997681 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412d4bf68a1148ea8fd550fadb1d11a9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:56.010474 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412d4bf68a1148ea8fd550fadb1d11a9'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:56.022680 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1464/2932] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:40:55 2022] DELETE /identity/v3/users/412d4bf68a1148ea8fd550fadb1d11a9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:40:56.027183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814fb0-128f-4c88-b0a2-dd05d8402922 None None] REQUEST_METHOD: `POST` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:56.029994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814fb0-128f-4c88-b0a2-dd05d8402922 None None] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:56.029994 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814fb0-128f-4c88-b0a2-dd05d8402922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:56.047547 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.auth.core [None req-ca814fb0-128f-4c88-b0a2-dd05d8402922 None None] MFA Rules not processed for user `de668eb3aa574c6fb312d4e0c57de17b`. Rule list: `[]` (Enabled: `True`). {{(pid=81685) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:40:56.048775 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ca814fb0-128f-4c88-b0a2-dd05d8402922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:56.110026 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1469/2933] 10.222.0.39 () {58 vars in 958 bytes} [Mon Sep 5 12:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:40:56.120277 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:56.121715 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:56.181461 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198306-9ede-4b9b-9a48-c2440d7c7d6c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:56.185125 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:56.185730 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:56.186014 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:56.186290 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:56.195207 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:56.196638 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:56.206029 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1465/2934] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:40:56.574166 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca814fb0-128f-4c88-b0a2-dd05d8402922 None None] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:40:56.575610 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-ca814fb0-128f-4c88-b0a2-dd05d8402922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:40:56.589722 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca814fb0-128f-4c88-b0a2-dd05d8402922 None None] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:40:56.595153 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:40:56.595982 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:40:56.596271 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:40:56.596533 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] PATH_INFO: `/v3/projects/8b04c17710104a448d3ee8a7109c7df0` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:40:56.597797 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b04c17710104a448d3ee8a7109c7df0)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:40:56.599760 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:40:56.710445 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b04c17710104a448d3ee8a7109c7df0', 'request_id': 'req-808fd49c-2a75-48d3-b390-eef1905309e4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:56.717183 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b04c17710104a448d3ee8a7109c7df0', 'request_id': 'req-808fd49c-2a75-48d3-b390-eef1905309e4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:56.722655 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b04c17710104a448d3ee8a7109c7df0', 'request_id': 'req-808fd49c-2a75-48d3-b390-eef1905309e4'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:56.812155 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] The token cache is being invalidate because project 8b04c17710104a448d3ee8a7109c7df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81685) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:40:56.812599 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:56.813274 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:40:56.814778 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1470/2935] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:40:56 2022] DELETE /identity/v3/projects/8b04c17710104a448d3ee8a7109c7df0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:41:06.201908 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:06.808839 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:11.728514 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:41:11.730117 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:41:11.741309 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8fbaf-4692-4e94-8902-a580135ba30e service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:41:11.790132 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:41:11.791278 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:41:11.791712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:41:11.792164 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:41:11.794023 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:41:11.879031 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:41:11.880466 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:41:11.901479 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1466/2936] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:41:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:41:13.101197 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:41:13.102693 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:41:13.115017 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fd49c-2a75-48d3-b390-eef1905309e4 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:41:13.118679 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:41:13.119311 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:41:13.119572 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:41:13.119846 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:41:13.121674 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:41:13.138001 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:41:13.139805 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:41:13.151822 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1471/2937] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:41:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:41:21.898342 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=63 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:41:23.146098 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=6 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:00.308158 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:42:00.309951 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:00.327953 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8e747-c16a-4e17-b089-95a978077c96 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:42:00.333919 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678608d9-4084-4f4c-b831-b8a450761145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2029f59c77de4240a78dba6960735bde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:42:00.334551 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678608d9-4084-4f4c-b831-b8a450761145 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:00.334838 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678608d9-4084-4f4c-b831-b8a450761145 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:00.335114 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678608d9-4084-4f4c-b831-b8a450761145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:00.336906 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-678608d9-4084-4f4c-b831-b8a450761145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:00.350292 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678608d9-4084-4f4c-b831-b8a450761145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:42:00.351952 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678608d9-4084-4f4c-b831-b8a450761145 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:42:00.367401 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1467/2938] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:42:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:42:00.441962 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:42:00.451751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fda7d-defc-4639-8ef7-77e58f36d39e service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:42:00.456040 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa7ce8d93f864130a3c079b1aec6b678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:42:00.457256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:00.457256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:00.457256 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:00.460025 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:00.472131 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:42:00.478152 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:42:00.489306 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1472/2939] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:42:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:42:09.809920 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8026df-b07b-4b92-ad2c-82876b6e9ab6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:09.810441 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8026df-b07b-4b92-ad2c-82876b6e9ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:09.810546 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8026df-b07b-4b92-ad2c-82876b6e9ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:09.861391 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9b8026df-b07b-4b92-ad2c-82876b6e9ab6 None None] MFA Rules not processed for user `7160f78808c54480acff300737dcb15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:42:09.862619 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9b8026df-b07b-4b92-ad2c-82876b6e9ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:09.930520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1468/2940] 10.222.0.39 () {58 vars in 967 bytes} [Mon Sep 5 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:42:09.972338 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:42:09.973844 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:10.069812 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5ce3c-87eb-46b5-a752-ac9e1574ead9 service neutron] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:42:10.075427 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '939c785e259f445a97c737152ae96a6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:42:10.076043 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:10.076326 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:10.076602 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:10.087651 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:42:10.089755 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:42:10.100678 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1473/2941] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Sep 5 12:42:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:42:15.397174 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8026df-b07b-4b92-ad2c-82876b6e9ab6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:42:15.405367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9b8026df-b07b-4b92-ad2c-82876b6e9ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:15.492520 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8026df-b07b-4b92-ad2c-82876b6e9ab6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:42:15.498049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:42:15.498684 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:15.499563 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:15.499843 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:15.502049 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:15.517291 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:42:15.518832 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:42:15.530801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1469/2942] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:42:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:42:20.095767 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:42:20.096647 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=47 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:20.098210 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:20.184662 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d9b60-9e6b-4b9a-a75a-7dc6318d1412 service swift] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:42:20.189707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:42:20.190392 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:20.190707 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:20.190997 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] PATH_INFO: `/v3/users/1055416c9d2e482c9d3a88db3af4e479` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:20.192176 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1055416c9d2e482c9d3a88db3af4e479)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:42:20.194175 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:42:20.387436 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1055416c9d2e482c9d3a88db3af4e479'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:20.388109 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1055416c9d2e482c9d3a88db3af4e479'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:20.778876 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1055416c9d2e482c9d3a88db3af4e479'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:20.792226 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1055416c9d2e482c9d3a88db3af4e479'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:20.792890 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1055416c9d2e482c9d3a88db3af4e479'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:20.815627 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1474/2943] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:42:20 2022] DELETE /identity/v3/users/1055416c9d2e482c9d3a88db3af4e479 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:42:21.093900 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:42:21.111415 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d4f8b-13b6-4ba5-a7c3-5d65fdf45c0f service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:42:21.175801 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:21.190973 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:42:21.191630 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:21.191909 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:21.192183 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] PATH_INFO: `/v3/projects/9bc42a5a83df468d8e143b3ea239184b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:21.193439 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc42a5a83df468d8e143b3ea239184b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:42:21.195371 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:42:21.297504 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc42a5a83df468d8e143b3ea239184b', 'request_id': 'req-1a3659d1-6799-4ba5-a361-41ac9f174eae'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.316198 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc42a5a83df468d8e143b3ea239184b', 'request_id': 'req-1a3659d1-6799-4ba5-a361-41ac9f174eae'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.323994 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc42a5a83df468d8e143b3ea239184b', 'request_id': 'req-1a3659d1-6799-4ba5-a361-41ac9f174eae'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.384690 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] The token cache is being invalidate because project 9bc42a5a83df468d8e143b3ea239184b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:42:21.385113 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.386213 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.388087 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1470/2944] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:42:21 2022] DELETE /identity/v3/projects/9bc42a5a83df468d8e143b3ea239184b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:42:21.395940 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:42:21.399045 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:21.418366 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04971ac3-19cb-4479-958b-b8d79a135998 admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:42:21.491196 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:42:21.491885 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:21.492199 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:21.492507 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] PATH_INFO: `/v3/users/270ff2c22a2041a791272040ad7fb319` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:21.493685 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=270ff2c22a2041a791272040ad7fb319)` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:42:21.495837 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:42:21.520365 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:21.730128 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270ff2c22a2041a791272040ad7fb319'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.730751 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270ff2c22a2041a791272040ad7fb319'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.816833 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270ff2c22a2041a791272040ad7fb319'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.831170 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270ff2c22a2041a791272040ad7fb319'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.831935 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.notifications [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270ff2c22a2041a791272040ad7fb319'} {{(pid=81685) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:21.845125 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1475/2945] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Sep 5 12:42:21 2022] DELETE /identity/v3/users/270ff2c22a2041a791272040ad7fb319 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:42:22.117714 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:42:22.119554 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:42:22.139021 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3659d1-6799-4ba5-a361-41ac9f174eae admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:42:22.196895 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de668eb3aa574c6fb312d4e0c57de17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a729dadde8474df3811deb87cd30d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:42:22.197553 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:42:22.198367 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:42:22.198627 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] PATH_INFO: `/v3/projects/839cc9fdbca94efd93d0e7ec736911c2` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:42:22.199756 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] RBAC: Authorizing `identity:delete_project(project_id=839cc9fdbca94efd93d0e7ec736911c2)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:42:22.201720 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:42:22.282753 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839cc9fdbca94efd93d0e7ec736911c2', 'request_id': 'req-eff74e50-6c88-444e-bd7f-c777f7a9e13e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:22.289192 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839cc9fdbca94efd93d0e7ec736911c2', 'request_id': 'req-eff74e50-6c88-444e-bd7f-c777f7a9e13e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:22.294818 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839cc9fdbca94efd93d0e7ec736911c2', 'request_id': 'req-eff74e50-6c88-444e-bd7f-c777f7a9e13e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:22.345944 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] The token cache is being invalidate because project 839cc9fdbca94efd93d0e7ec736911c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:42:22.348641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:22.348641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eff74e50-6c88-444e-bd7f-c777f7a9e13e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:42:22.348641 dv-cinder-801354-7-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1471/2946] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Sep 5 12:42:22 2022] DELETE /identity/v3/projects/839cc9fdbca94efd93d0e7ec736911c2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:42:31.841148 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:42:32.342712 dv-cinder-801354-7-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:44:27.685263 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] Authenticating user token {{(pid=81685) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:44:27.686989 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:44:27.757376 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324fd65-8053-46d6-b789-c4a92e222b6e admin admin] Validating token access rules against request {{(pid=81685) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:44:27.815253 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3825c-fd63-45ac-ae50-3f86b1c67893 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '727c462d975449c7807f774df4e4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '786e5d0bf66f42b7b6c134c11a7e3f0a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81685) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:44:27.815841 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3825c-fd63-45ac-ae50-3f86b1c67893 service placement] REQUEST_METHOD: `GET` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:44:27.816119 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3825c-fd63-45ac-ae50-3f86b1c67893 service placement] SCRIPT_NAME: `/identity` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:44:27.816388 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3825c-fd63-45ac-ae50-3f86b1c67893 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81685) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:44:27.818110 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.fernet_utils [None req-5cf3825c-fd63-45ac-ae50-3f86b1c67893 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81685) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:44:27.830923 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3825c-fd63-45ac-ae50-3f86b1c67893 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:44:27.832061 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3825c-fd63-45ac-ae50-3f86b1c67893 service placement] RBAC: Authorization granted {{(pid=81685) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:44:27.842875 dv-cinder-801354-7-smb devstack@keystone.service[81685]: [pid: 81685|app: 0|req: 1476/2947] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Sep 5 12:44:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:44:37.838546 dv-cinder-801354-7-smb devstack@keystone.service[81685]: DEBUG dbcounter [-] [81685] Writing DB stats keystone:SELECT=58 {{(pid=81685) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}